arXiv Science⌕ Search

arXiv subjects

Takashi Goda

Publications and source records attributed to Takashi Goda.

At least 37 records · Page 2Linked to original sources

Quasi-Monte Carlo hyperinterpolation

This paper studies a generalization of hyperinterpolation over the high-dimensional unit cube. Hyperinterpolation of degree \( m \) serves as a discrete approximation of the \( L_2 \)-orthogonal projection of the same degree, using Fourier coefficients evaluated by a positive-weight quadrature rule that exactly integrates all polynomials of degree up to \( 2m \). Traditional hyperinterpolation methods often depend on exact quadrature assumptions, which can be impractical in high-dimensional contexts. We address the challenges and advancements in hyperinterpolation, bypassing the assumption of exactness for quadrature rules by replacing it with quasi-Monte Carlo (QMC) rules and propose a novel approximation scheme with an index set \( I \), which is referred to as QMC hyperinterpolation of range \( I \). In particular, we provide concrete construction algorithms for QMC hyperinterpolation with certain lattice rules. Consequently, we show that QMC hyperinterpolation achieves accuracy comparable to traditional hyperinterpolation while avoiding its higher computational costs. Furthermore, we introduce a Lasso-based approach to improve the robustness of QMC hyperinterpolation against noise from sampling processes. Numerical experiments validate the efficacy of our proposed methods.

math.NA↗

A note on unshifted lattice rules for high-dimensional integration in weighted unanchored Sobolev spaces

This short article studies a deterministic quasi-Monte Carlo lattice rule in weighted unanchored Sobolev spaces of smoothness $1$. Building on the error analysis by Kazashi and Sloan, we prove the existence of unshifted rank-1 lattice rules that achieve a worst-case error of $O(n^{-1/4}(\log n)^{1/2})$, with the implied constant independent of the dimension, under certain summability conditions on the weights. Although this convergence rate is inferior to the one achievable for the shifted-averaged root mean squared worst-case error, the result does not rely on random shifting or transformation and holds unconditionally without any conjecture, as assumed by Kazashi and Sloan.

math.NA↗

Tractability results for integration in subspaces of the Wiener algebra

In this paper, we present some new (in-)tractability results related to the integration problem in subspaces of the Wiener algebra over the $d$-dimensional unit cube. We show that intractability holds for multivariate integration in the standard Wiener algebra in the deterministic setting, in contrast to polynomial tractability in an unweighted subspace of the Wiener algebra recently shown by Goda (2023). Moreover, we prove that multivariate integration in the subspace of the Wiener algebra introduced by Goda is strongly polynomially tractable if we switch to the randomized setting, where we obtain a better $\varepsilon$-exponent than the one implied by the standard Monte Carlo method. We also identify subspaces in which multivariate integration in the deterministic setting are (strongly) polynomially tractable and we compare these results with the bound which can be obtained via Hoeffding's inequality.

cs.CC↗

A simple universal algorithm for high-dimensional integration

We present a simple universal algorithm for high-dimensional integration which has the optimal error rate (independent of the dimension) in all weighted Korobov classes both in the randomized and the deterministic setting. Our theoretical findings are complemented by numerical tests.

math.NA↗

A randomized lattice rule without component-by-component construction

We study the multivariate integration problem for periodic functions from the weighted Korobov space in the randomized setting. We introduce a new randomized rank-1 lattice rule with a randomly chosen number of points, which avoids the need for component-by-component construction in the search for good generating vectors while still achieving nearly the optimal rate of the randomized error. Our idea is to exploit the fact that at least half of the possible generating vectors yield nearly the optimal rate of the worst-case error in the deterministic setting. By randomly choosing generating vectors $r$ times and comparing their corresponding worst-case errors, one can find one generating vector with a desired worst-case error bound with a very high probability, and the (small) failure probability can be controlled by increasing $r$ logarithmically as a function of the number of points. Numerical experiments are conducted to support our theoretical findings.

math.NA↗

How sharp are error bounds? --lower bounds on quadrature worst-case errors for analytic functions

Numerical integration over the real line for analytic functions is studied. Our main focus is on the sharpness of the error bounds. We first derive two general lower estimates for the worst-case integration error, and then apply these to establish lower bounds for various quadrature rules. These bounds turn out to be either novel or improve upon existing results, leading to lower bounds that closely match upper bounds for various formulas. Specifically, for the suitably truncated trapezoidal rule, we improve upon general lower bounds on the worst-case error obtained by Sugihara [\textit{Numer. Math.}, 75 (1997), pp.~379--395] and provide exceptionally sharp lower bounds apart from a polynomial factor, and in particular show that the worst-case error for the trapezoidal rule by Sugihara is not improvable by more than a polynomial factor. Additionally, our research reveals a discrepancy between the error decay of the trapezoidal rule and Sugihara's lower bound for general numerical integration rules, introducing a new open problem. Moreover, Gauss--Hermite quadrature is proven sub-optimal under the decay conditions on integrands we consider, a result not deducible from upper-bound arguments alone. Furthermore, to establish the near-optimality of the suitably scaled Gauss--Legendre and Clenshaw--Curtis quadratures, we generalize a recent result of Trefethen [\textit{SIAM Rev.}, 64 (2022), pp.~132--150] for the upper error bounds in terms of the decay conditions.

math.NA↗

One-dimensional quasi-uniform Kronecker sequences

In this short note, we prove that the one-dimensional Kronecker sequence $iα\bmod 1, i=0,1,2,\ldots,$ is quasi-uniform if and only if $α$ is a badly approximable number. Our elementary proof relies on a result on the three-gap theorem for Kronecker sequences due to Halton (1965).

math.NT↗

The Sobol' sequence is not quasi-uniform in dimension 2

Are common quasi-Monte Carlo sequences quasi-uniform? While this question remains widely open, in this short note, we prove that the two-dimensional Sobol' sequence is not quasi-uniform. This result partially answers an unsolved problem of Sobol' and Shukhman (2007) in a negative manner.

math.NA↗

A universal median quasi-Monte Carlo integration

We study quasi-Monte Carlo (QMC) integration over the multi-dimensional unit cube in several weighted function spaces with different smoothness classes. We consider approximating the integral of a function by the median of several integral estimates under independent and random choices of the underlying QMC point sets (either linearly scrambled digital nets or infinite-precision polynomial lattice point sets). Even though our approach does not require any information on the smoothness and weights of a target function space as an input, we can prove a probabilistic upper bound on the worst-case error for the respective weighted function space, where the failure probability converges to 0 exponentially fast as the number of estimates increases. Our obtained rates of convergence are nearly optimal for function spaces with finite smoothness, and we can attain a dimension-independent super-polynomial convergence for a class of infinitely differentiable functions. This implies that our median-based QMC rule is universal in the sense that it does not need to be adjusted to the smoothness and the weights of the function spaces and yet exhibits the nearly optimal rate of convergence. Numerical experiments support our theoretical results.

math.NA↗

Randomizing the trapezoidal rule gives the optimal RMSE rate in Gaussian Sobolev spaces

Randomized quadratures for integrating functions in Sobolev spaces of order $α\ge 1$, where the integrability condition is with respect to the Gaussian measure, are considered. In this function space, the optimal rate for the worst-case root-mean-squared error (RMSE) is established. Here, optimality is for a general class of quadratures, in which adaptive non-linear algorithms with a possibly varying number of function evaluations are also allowed. The optimal rate is given by showing matching bounds. First, a lower bound on the worst-case RMSE of $O(n^{-α-1/2})$ is proven, where $n$ denotes an upper bound on the expected number of function evaluations. It turns out that a suitably randomized trapezoidal rule attains this rate, up to a logarithmic factor. A practical error estimator for this trapezoidal rule is also presented. Numerical results support our theory.

math.NA↗

Estimating nested expectations without inner conditional sampling and application to value of information analysis

Motivated by various computational applications, we investigate the problem of estimating nested expectations. Building upon recent work by the authors, we propose a novel Monte Carlo estimator for nested expectations, inspired by sparse grid quadrature, that does not require sampling from inner conditional distributions. Theoretical analysis establishes an upper bound on the mean squared error of our estimator under mild assumptions on the problem, demonstrating its efficiency for cases with low-dimensional outer variables. We illustrate the effectiveness of our estimator through its application to problems related to value of information analysis, with moderate dimensionality. Overall, our method presents a promising approach to efficiently estimate nested expectations in practical computational settings.

math.NA↗

Strong tractability for multivariate integration in a subspace of the Wiener algebra

Building upon recent work by the author, we prove that multivariate integration in the following subspace of the Wiener algebra over $[0,1)^d$ is strongly polynomially tractable: \[ F_d:=\left\{ f\in C([0,1)^d)\:\middle| \: \|f\|:=\sum_{\boldsymbol{k}\in \mathbb{Z}^{d}}|\hat{f}(\boldsymbol{k})|\max\left(\mathrm{width}(\mathrm{supp}(\boldsymbol{k})),\min_{j\in \mathrm{supp}(\boldsymbol{k})}\log |k_j|\right)<\infty \right\},\] with $\hat{f}(\boldsymbol{k})$ being the $\boldsymbol{k}$-th Fourier coefficient of $f$, $\mathrm{supp}(\boldsymbol{k}):=\{j\in \{1,\ldots,d\}\mid k_j\neq 0\}$, and $\mathrm{width}: 2^{\{1,\ldots,d\}}\to \{1,\ldots,d\}$ being defined by \[ \mathrm{width}(u):=\max_{j\in u}j-\min_{j\in u}j+1,\] for non-empty subset $u\subseteq \{1,\ldots,d\}$ and $\mathrm{width}(\emptyset):=1$. Strong polynomial tractability is achieved by an explicit quasi-Monte Carlo rule using a multiset union of Korobov's $p$-sets. We also show that, if we replace $\mathrm{width}(\mathrm{supp}(\boldsymbol{k}))$ with 1 for all $\boldsymbol{k}\in \mathbb{Z}^d$ in the above definition of norm, multivariate integration is polynomially tractable but not strongly polynomially tractable.

math.NA↗

Polynomial tractability for integration in an unweighted function space with absolutely convergent Fourier series

In this note, we prove that the following function space with absolutely convergent Fourier series \[ F_d:=\left\{ f\in L^2([0,1)^d)\:\middle| \: \|f\|:=\sum_{\boldsymbol{k}\in \mathbb{Z}^d}|\hat{f}(\boldsymbol{k})| \max\left(1,\min_{j\in \mathrm{supp}(\boldsymbol{k})}\log |k_j|\right) <\infty \right\}\] with $\hat{f}(\boldsymbol{k})$ being the $\boldsymbol{k}$-th Fourier coefficient of $f$ and $\mathrm{supp}(\boldsymbol{k}):=\{j\in \{1,\ldots,d\}\mid k_j\neq 0\}$ is polynomially tractable for multivariate integration in the worst-case setting. Here polynomial tractability means that the minimum number of function evaluations required to make the worst-case error less than or equal to a tolerance $\varepsilon$ grows only polynomially with respect to $\varepsilon^{-1}$ and $d$. It is important to remark that the function space $F_d$ is unweighted, that is, all variables contribute equally to the norm of functions. Our tractability result is in contrast to those for most of the unweighted integration problems studied in the literature, in which polynomial tractability does not hold and the problem suffers from the curse of dimensionality. Our proof is constructive in the sense that we provide an explicit quasi-Monte Carlo rule that attains a desired worst-case error bound.

math.NA↗

Sub-optimality of Gauss--Hermite quadrature and optimality of the trapezoidal rule for functions with finite smoothness

The sub-optimality of Gauss--Hermite quadrature and the optimality of the trapezoidal rule are proved in the weighted Sobolev spaces of square integrable functions of order $α$, where the optimality is in the sense of worst-case error. For Gauss--Hermite quadrature, we obtain matching lower and upper bounds, which turn out to be merely of the order $n^{-α/2}$ with $n$ function evaluations, although the optimal rate for the best possible linear quadrature is known to be $n^{-α}$. Our proof of the lower bound exploits the structure of the Gauss--Hermite nodes; the bound is independent of the quadrature weights, and changing the Gauss--Hermite weights cannot improve the rate $n^{-α/2}$. In contrast, we show that a suitably truncated trapezoidal rule achieves the optimal rate up to a logarithmic factor.

math.NA↗

Improved bounds on the gain coefficients for digital nets in prime power base

We study randomized quasi-Monte Carlo integration by scrambled nets. The scrambled net quadrature has long gained its popularity because it is an unbiased estimator of the true integral, allows for a practical error estimation, achieves a high order decay of the variance for smooth functions, and works even for $L^p$-functions with any $p\geq 1$. The variance of the scrambled net quadrature for $L^2$-functions can be evaluated through the set of the so-called gain coefficients. In this paper, based on the system of Walsh functions and the concept of dual nets, we provide improved upper bounds on the gain coefficients for digital nets in general prime power base. Our results explain the known bound by Owen (1997) for Faure sequences, the recently improved bound by Pan and Owen (2021) for digital nets in base 2 (including Sobol' sequences as a special case), and their finding that all the nonzero gain coefficients for digital nets in base 2 must be powers of two, all in a unified way.

math.NA↗

Constructing unbiased gradient estimators with finite variance for conditional stochastic optimization

We study stochastic gradient descent for solving conditional stochastic optimization problems, in which an objective to be minimized is given by a parametric nested expectation with an outer expectation taken with respect to one random variable and an inner conditional expectation with respect to the other random variable. The gradient of such a parametric nested expectation is again expressed as a nested expectation, which makes it hard for the standard nested Monte Carlo estimator to be unbiased. In this paper, we show under some conditions that a multilevel Monte Carlo gradient estimator is unbiased and has finite variance and finite expected computational cost, so that the standard theory from stochastic optimization for a parametric (non-nested) expectation directly applies. We also discuss a special case for which yet another unbiased gradient estimator with finite variance and cost can be constructed.

math.NA↗

An efficient estimation of nested expectations without conditional sampling

Estimating nested expectations is an important task in computational mathematics and statistics. In this paper we propose a new Monte Carlo method using post-stratification to estimate nested expectations efficiently without taking samples of the inner random variable from the conditional distribution given the outer random variable. This property provides the advantage over many existing methods that it enables us to estimate nested expectations only with a dataset on the pair of the inner and outer variables drawn from the joint distribution. We show an upper bound on the mean squared error of the proposed method under some assumptions. Numerical experiments are conducted to compare our proposed method with several existing methods (nested Monte Carlo method, multilevel Monte Carlo method, and regression-based method), and we see that our proposed method is superior to the compared methods in terms of efficiency and applicability.

math.NA↗

Construction-free median quasi-Monte Carlo rules for function spaces with unspecified smoothness and general weights

We study quasi-Monte Carlo (QMC) integration of smooth functions defined over the multi-dimensional unit cube. Inspired by a recent work of Pan and Owen, we study a new construction-free median QMC rule which can exploit the smoothness and the weights of function spaces adaptively. For weighted Korobov spaces, we draw a sample of $r$ independent generating vectors of rank-1 lattice rules, compute the integral estimate for each, and approximate the true integral by the median of these $r$ estimates. For weighted Sobolev spaces, we use the same approach but with the rank-1 lattice rules replaced by high-order polynomial lattice rules. A major advantage over the existing approaches is that we do not need to construct good generating vectors by a computer search algorithm, while our median QMC rule achieves almost the optimal worst-case error rate for the respective function space with any smoothness and weights, with a probability that converges to 1 exponentially fast as $r$ increases. Numerical experiments illustrate and support our theoretical findings.

math.NA↗