arXiv Science⌕ Search

arXiv subjects

Takashi Goda

Publications and source records attributed to Takashi Goda.

At least 55 records · Page 3Linked to original sources
arXiv2022

Component-by-component construction of randomized rank-1 lattice rules achieving almost the optimal randomized error rate

We study a randomized quadrature algorithm to approximate the integral of periodic functions defined over the high-dimensional unit cube. Recent work by Kritzer, Kuo, Nuyens and Ullrich (2019) shows that rank-1 lattice rules with a randomly chosen number of points and good generating vector achieve almost the optimal order of the randomized error in weighted Korobov spaces, and moreover, that the error is bounded independently of the dimension if the weight parameters, $γ_j$, satisfy the summability condition $\sum_{j=1}^{\infty}γ_j^{1/α}<\infty$, where $α$ is a smoothness parameter. The argument is based on the existence result that at least half of the possible generating vectors yield almost the optimal order of the worst-case error in the same function spaces. In this paper we provide a component-by-component construction algorithm of such randomized rank-1 lattice rules, without any need to check whether the constructed generating vectors satisfy a desired worst-case error bound. Similarly to the above-mentioned work, we prove that our algorithm achieves almost the optimal order of the randomized error and that the error bound is independent of the dimension if the same condition $\sum_{j=1}^{\infty}γ_j^{1/α}<\infty$ holds. We also provide analogous results for tent-transformed lattice rules for weighted half-period cosine spaces and for polynomial lattice rules in weighted Walsh spaces, respectively.

math.NA↗
arXiv2022

A note on concatenation of quasi-Monte Carlo and plain Monte Carlo rules in high dimensions

In this note, we study a concatenation of quasi-Monte Carlo and plain Monte Carlo rules for high-dimensional numerical integration in weighted function spaces. In particular, we consider approximating the integral of periodic functions defined over the $s$-dimensional unit cube by using rank-1 lattice point sets only for the first $d\, (<s)$ coordinates and random points for the remaining $s-d$ coordinates. We prove that, by exploiting a decay of the weights of function spaces, almost the optimal order of the mean squared worst-case error is achieved by such a concatenated quadrature rule as long as $d$ scales at most linearly with the number of points. This result might be useful for numerical integration in extremely high dimensions, such as partial differential equations with random coefficients for which even the standard fast component-by-component algorithm is considered computationally expensive.

math.NA↗
arXiv2021

Unbiased MLMC stochastic gradient-based optimization of Bayesian experimental designs

In this paper we propose an efficient stochastic optimization algorithm to search for Bayesian experimental designs such that the expected information gain is maximized. The gradient of the expected information gain with respect to experimental design parameters is given by a nested expectation, for which the standard Monte Carlo method using a fixed number of inner samples yields a biased estimator. In this paper, applying the idea of randomized multilevel Monte Carlo (MLMC) methods, we introduce an unbiased Monte Carlo estimator for the gradient of the expected information gain with finite expected squared $\ell_2$-norm and finite expected computational cost per sample. Our unbiased estimator can be combined well with stochastic gradient descent algorithms, which results in our proposal of an optimization algorithm to search for an optimal Bayesian experimental design. Numerical experiments confirm that our proposed algorithm works well not only for a simple test problem but also for a more realistic pharmacokinetic problem.

stat.CO↗
arXiv2021

A simple algorithm for global sensitivity analysis with Shapley effects

Global sensitivity analysis aims at measuring the relative importance of different variables or groups of variables for the variability of a quantity of interest. Among several sensitivity indices, so-called Shapley effects have recently gained popularity mainly because the Shapley effects for all the individual variables are summed up to the overall variance, which gives a better interpretability than the classical sensitivity indices called main effects and total effects. In this paper, assuming that all the input variables are independent, we introduce a quite simple Monte Carlo algorithm to estimate the Shapley effects for all the individual variables simultaneously, which drastically simplifies the existing algorithms proposed in the literature. We present a short Matlab implementation of our algorithm and show some numerical results. A possible extension to the case where the input variables are dependent is also discussed.

stat.CO↗
arXiv2021

Efficient Debiased Evidence Estimation by Multilevel Monte Carlo Sampling

In this paper, we propose a new stochastic optimization algorithm for Bayesian inference based on multilevel Monte Carlo (MLMC) methods. In Bayesian statistics, biased estimators of the model evidence have been often used as stochastic objectives because the existing debiasing techniques are computationally costly to apply. To overcome this issue, we apply an MLMC sampling technique to construct low-variance unbiased estimators both for the model evidence and its gradient. In the theoretical analysis, we show that the computational cost required for our proposed MLMC estimator to estimate the model evidence or its gradient with a given accuracy is an order of magnitude smaller than those of the previously known estimators. Our numerical experiments confirm considerable computational savings compared to the conventional estimators. Combining our MLMC estimator with gradient-based stochastic optimization results in a new scalable, efficient, debiased inference algorithm for Bayesian statistical models.

stat.ML↗
arXiv2020

Toeplitz Monte Carlo

Motivated mainly by applications to partial differential equations with random coefficients, we introduce a new class of Monte Carlo estimators, called Toeplitz Monte Carlo (TMC) estimator for approximating the integral of a multivariate function with respect to the direct product of an identical univariate probability measure. The TMC estimator generates a sequence $x_1,x_2,\ldots$ of i.i.d. samples for one random variable, and then uses $(x_{n+s-1},x_{n+s-2}\ldots,x_n)$ with $n=1,2,\ldots$ as quadrature points, where $s$ denotes the dimension. Although consecutive points have some dependency, the concatenation of all quadrature nodes is represented by a Toeplitz matrix, which allows for a fast matrix-vector multiplication. In this paper we study the variance of the TMC estimator and its dependence on the dimension $s$. Numerical experiments confirm the considerable efficiency improvement over the standard Monte Carlo estimator for applications to partial differential equations with random coefficients, particularly when the dimension $s$ is large.

math.NA↗
arXiv2020

Multilevel Monte Carlo estimation of the expected value of sample information

We study Monte Carlo estimation of the expected value of sample information (EVSI) which measures the expected benefit of gaining additional information for decision making under uncertainty. EVSI is defined as a nested expectation in which an outer expectation is taken with respect to one random variable $Y$ and an inner conditional expectation with respect to the other random variable $θ$. Although the nested (Markov chain) Monte Carlo estimator has been often used in this context, a root-mean-square accuracy of $\varepsilon$ is achieved notoriously at a cost of $O(\varepsilon^{-2-1/α})$, where $α$ denotes the order of convergence of the bias and is typically between $1/2$ and $1$. In this article we propose a novel efficient Monte Carlo estimator of EVSI by applying a multilevel Monte Carlo (MLMC) method. Instead of fixing the number of inner samples for $θ$ as done in the nested Monte Carlo estimator, we consider a geometric progression on the number of inner samples, which yields a hierarchy of estimators on the inner conditional expectation with increasing approximation levels. Based on an elementary telescoping sum, our MLMC estimator is given by a sum of the Monte Carlo estimates of the differences between successive approximation levels on the inner conditional expectation. We show, under a set of assumptions on decision and information models, that successive approximation levels are tightly coupled, which directly proves that our MLMC estimator improves the necessary computational cost to optimal $O(\varepsilon^{-2})$. Numerical experiments confirm the considerable computational savings as compared to the nested Monte Carlo estimator.

math.NA↗
arXiv2020

Stability of lattice rules and polynomial lattice rules constructed by the component-by-component algorithm

We study quasi-Monte Carlo (QMC) methods for numerical integration of multivariate functions defined over the high-dimensional unit cube. Lattice rules and polynomial lattice rules, which are special classes of QMC methods, have been intensively studied and the so-called component-by-component (CBC) algorithm has been well-established to construct rules which achieve the almost optimal rate of convergence with good tractability properties for given smoothness and set of weights. Since the CBC algorithm constructs rules for given smoothness and weights, not much is known when such rules are used for function classes with different smoothness and/or weights. In this paper we prove that a lattice rule constructed by the CBC algorithm for the weighted Korobov space with given smoothness and weights achieves the almost optimal rate of convergence with good tractability properties for general classes of smoothness and weights which satisfy some summability conditions. Such a stability result also can be shown for polynomial lattice rules in weighted Walsh spaces. We further give bounds on the weighted star discrepancy and discuss the tractability properties for these QMC rules. The results are comparable to those obtained for Halton, Sobol and Niederreiter sequences.

math.NA↗
arXiv2019

Multilevel Monte Carlo estimation of expected information gains

The expected information gain is an important quality criterion of Bayesian experimental designs, which measures how much the information entropy about uncertain quantity of interest $θ$ is reduced on average by collecting relevant data $Y$. However, estimating the expected information gain has been considered computationally challenging since it is defined as a nested expectation with an outer expectation with respect to $Y$ and an inner expectation with respect to $θ$. In fact, the standard, nested Monte Carlo method requires a total computational cost of $O(\varepsilon^{-3})$ to achieve a root-mean-square accuracy of $\varepsilon$. In this paper we develop an efficient algorithm to estimate the expected information gain by applying a multilevel Monte Carlo (MLMC) method. To be precise, we introduce an antithetic MLMC estimator for the expected information gain and provide a sufficient condition on the data model under which the antithetic property of the MLMC estimator is well exploited such that optimal complexity of $O(\varepsilon^{-2})$ is achieved. Furthermore, we discuss how to incorporate importance sampling techniques within the MLMC estimator to avoid arithmetic underflow. Numerical experiments show the considerable computational cost savings compared to the nested Monte Carlo method for a simple test case and a more realistic pharmacokinetic model.

stat.CO↗
arXiv2019

Recent advances in higher order quasi-Monte Carlo methods

In this article we review some of recent results on higher order quasi-Monte Carlo (HoQMC) methods. After a seminal work by Dick (2007, 2008) who originally introduced the concept of HoQMC, there have been significant theoretical progresses on HoQMC in terms of discrepancy as well as multivariate numerical integration. Moreover, several successful and promising applications of HoQMC to partial differential equations with random coefficients and Bayesian estimation/inversion problems have been reported recently. In this article we start with standard quasi-Monte Carlo methods based on digital nets and sequences in the sense of Niederreiter, and then move onto their higher order version due to Dick. The Walsh analysis of smooth functions plays a crucial role in developing the theory of HoQMC, and the aim of this article is to provide a unified picture on how the Walsh analysis enables recent developments of HoQMC both for discrepancy and numerical integration.

math.NA↗
arXiv2019

Richardson extrapolation allows truncation of higher order digital nets and sequences

We study numerical integration of smooth functions defined over the $s$-dimensional unit cube. A recent work by Dick et al. (2019) has introduced so-called extrapolated polynomial lattice rules, which achieve the almost optimal rate of convergence for numerical integration and can be constructed by the fast component-by-component search algorithm with smaller computational costs as compared to interlaced polynomial lattice rules. In this paper we prove that, instead of polynomial lattice point sets, truncated higher order digital nets and sequences can be used within the same algorithmic framework to explicitly construct good quadrature rules achieving the almost optimal rate of convergence. The major advantage of our new approach compared to original higher order digital nets is that we can significantly reduce the precision of points, i.e., the number of digits necessary to describe each quadrature node. This finding has a practically useful implication when either the number of points or the smoothness parameter is so large that original higher order digital nets require more than the available finite-precision floating point representations.

math.NA↗
arXiv2018

Richardson extrapolation of polynomial lattice rules

We study multivariate numerical integration of smooth functions in weighted Sobolev spaces with dominating mixed smoothness $α\geq 2$ defined over the $s$-dimensional unit cube. We propose a new quasi-Monte Carlo (QMC)-based quadrature rule, named \emph{extrapolated polynomial lattice rule}, which achieves the almost optimal rate of convergence. Extrapolated polynomial lattice rules are constructed in two steps: i) construction of classical polynomial lattice rules over $\mathbb{F}_b$ with $α$ consecutive sizes of nodes, $b^{m-α+1},\ldots,b^{m}$, and ii) recursive application of Richardson extrapolation to a chain of $α$ approximate values of the integral obtained by consecutive polynomial lattice rules. We prove the existence of good extrapolated polynomial lattice rules achieving the almost optimal order of convergence of the worst-case error in Sobolev spaces with general weights. Then, by restricting to product weights, we show that such good extrapolated polynomial lattice rules can be constructed by the fast component-by-component algorithm under a computable quality criterion. The required total construction cost is of order $(s+α)N\log N$, which improves the currently known result for interlaced polynomial lattice rule, that is of order $sαN\log N$. We also study the dependence of the worst-case error bound on the dimension. A big advantage of our method compared to interlaced polynomial lattice rules is that the fast QMC matrix vector method can be used in this setting, while still achieving the same rate of convergence. Such a method was previously not known. Numerical experiments for test integrands support our theoretical result.

math.NA↗
arXiv2018

Lattice rules in non-periodic subspaces of Sobolev spaces

We investigate quasi-Monte Carlo (QMC) integration over the $s$-dimensional unit cube based on rank-1 lattice point sets in weighted non-periodic Sobolev spaces $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{sob}})$ and their subspaces of high order smoothness $α>1$, where $\boldsymbolγ$ denotes a set of the weights. A recent paper by Dick, Nuyens and Pillichshammer has studied QMC integration in half-period cosine spaces with smoothness parameter $α>1/2$ consisting of non-periodic smooth functions, denoted by $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{cos}})$, and also in the sum of half-period cosine spaces and Korobov spaces with common parameter $α$, denoted by $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{kor}+\mathrm{cos}})$. Motivated by the results shown there, we first study embeddings and norm equivalences on those function spaces. In particular, for an integer $α$, we provide their corresponding norm-equivalent subspaces of $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{sob}})$. This implies that $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{kor}+\mathrm{cos}})$ is strictly smaller than $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{sob}})$ as sets for $α\geq 2$, which solves an open problem by Dick, Nuyens and Pillichshammer. Then we study the worst-case error of tent-transformed lattice rules in $\mathcal{H}(K_{2,\boldsymbolγ,s}^{\mathrm{sob}})$ and also the worst-case error of symmetrized lattice rules in an intermediate space between $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{kor}+\mathrm{cos}})$ and $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{sob}})$. We show that the almost optimal rate of convergence can be achieved for both cases, while a weak dependence of the worst-case error bound on the dimension can be obtained for the former case.

math.NA↗
arXiv2018

On the separability of multivariate functions

Separability of multivariate functions alleviates the difficulty in finding a minimum or maximum value of a function such that an optimal solution can be searched by solving several disjoint problems with lower dimensionalities. In most of practical problems, however, a function to be optimized is black-box and we hardly grasp its separability. In this study, we first describe a general separability condition which a function defined over an arbitrary domain satisfies if and only if the function is separable with respect to given disjoint subsets of variables. By introducing an alternative separability condition, we propose a Monte Carlo-based algorithm to estimate the separability of a function defined over unit cube with respect to given disjoint subsets of variables. Moreover, we extend our algorithm to estimate the number of disjoint subsets and the disjoint subsets such that a function is separable with respect to them. Computational complexity of our extended algorithm is function-dependent and varies from linear to exponential in the dimension.

math.NA↗
arXiv2018

Decision-making under uncertainty: using MLMC for efficient estimation of EVPPI

In this paper we develop a very efficient approach to the Monte Carlo estimation of the expected value of partial perfect information (EVPPI) that measures the average benefit of knowing the value of a subset of uncertain parameters involved in a decision model. The calculation of EVPPI is inherently a nested expectation problem, with an outer expectation with respect to one random variable $X$ and an inner conditional expectation with respect to the other random variable $Y$. We tackle this problem by using a Multilevel Monte Carlo (MLMC) method (Giles 2008) in which the number of inner samples for $Y$ increases geometrically with level, so that the accuracy of estimating the inner conditional expectation improves and the cost also increases with level. We construct an antithetic MLMC estimator and provide sufficient assumptions on a decision model under which the antithetic property of the estimator is well exploited, and consequently a root-mean-square accuracy of $\varepsilon$ can be achieved at a cost of $O(\varepsilon^{-2})$. Numerical results confirm the considerable computational savings compared to the standard, nested Monte Carlo method for some simple testcases and a more realistic medical application.

math.NA↗
arXiv2017

Quasi-Monte Carlo integration for twice differentiable functions over a triangle

We study quasi-Monte Carlo integration for twice differentiable functions defined over a triangle. We provide an explicit construction of infinite sequences of points including one by Basu and Owen (2015) as a special case, which achieves the integration error of order $N^{-1}(\log N)^3$ for any $N\geq 2$. Since a lower bound of order $N^{-1}$ on the integration error holds for any linear quadrature rule, the upper bound we obtain is best possible apart from the $\log N$ factor. The major ingredient in our proof of the upper bound is the dyadic Walsh analysis of twice differentiable functions over a triangle under a suitable recursive partitioning.

math.NA↗
arXiv2016

Construction of interlaced polynomial lattice rules for infinitely differentiable functions

We study multivariate integration over the $s$-dimensional unit cube in a weighted space of infinitely differentiable functions. It is known from a recent result by Suzuki that there exists a good quasi-Monte Carlo (QMC) rule which achieves a super-polynomial convergence of the worst-case error in this function space, and moreover, that this convergence behavior is independent of the dimension under a certain condition on the weights. In this paper we provide a constructive approach to finding a good QMC rule achieving such a dimension-independent super-polynomial convergence of the worst-case error. Specifically, we prove that interlaced polynomial lattice rules, with an interlacing factor chosen properly depending on the number of points $N$ and the weights, can be constructed using a fast component-by-component algorithm in at most $O(sN(\log N)^2)$ arithmetic operations to achieve a dimension-independent super-polynomial convergence. The key idea for the proof of the worst-case error bound is to use a variant of Jensen's inequality with a purposely-designed concave function.

math.NA↗