arXiv Science⌕ Search

arXiv subjects

Jason Beh

Publications and source records attributed to Jason Beh.

5 recordsLinked to original sources

Phase transition for conditional covariance matrices estimated by importance sampling, and implications for cross-entropy schemes in high dimension

Motivated by recent high-dimensional reliability algorithms, we study a random matrix model corresponding to the estimation by importance sampling of $Σ_A$, the covariance matrix of a Gaussian vector conditioned by a rare event $A$. For such models, we show that, in contrast to most random matrix models, the minimal sample size to ensure an accurate estimation of $Σ_A$ needs to grow superlinearly in the dimension. More precisely, if $n$ is the sample size and $d$ the dimension, we show that the estimation of $Σ_A$ is accurate if $n/d \gg L$ and not accurate if $n/d \ll L$ where $L$ is the maximum likelihood ratio. Moreover, we relate the asymptotic behavior of $L$ to $λ_1$, the smallest eigenvalue of the auxiliary covariance matrix, which suggests that $L$ (and thus the minimal sample size) will be larger for small values of $λ_1$. Numerical experiments confirm that this insight carries over to recent cross-entropy algorithms, with the best performing algorithms being also the ones with the largest smallest eigenvalue. Although backed up by our theoretical result, this result is surprising as these algorithms were not designed to act on the spectrum.

math.ST↗

Consistency considerations for rare-event importance sampling

We consider the problem of estimating a small probability $p = P(X \in A)$ by importance sampling with auxiliary density $g$, where $X$ is drawn according to some density $f$. We establish a simple necessary and sufficient condition for the consistency of the importance sampling estimator in triangular schemes where the dimension, the densities $f$ and $g$ and the set $A$ may evolve. It allows to refine the results of Chatterjee and Diaconis [Ann. Appl. Probab. 28 (2018), no. 2, 1099-1135] by establishing the exact minimal sample size required for consistency. Moreover, it allows to study the regime $p \to 0$ which, despite being the relevant mathematical regime for rare-event estimations, has received very little attention so far. We perform an in-depth study of the hyperplane case $A = \{x: x^\top u \geq α\}$ with Gaussian densities, showing that in this case, the optimal importance sampling density considerably improves consistency compared to the standard Monte Carlo estimator. However, we conclude the paper with moment considerations which suggest that, whenever the Monte Carlo and optimal importance sampling estimators both converge, convergence may occur faster for the Monte Carlo estimator.

math.ST↗

Sequential Entropic Optimal Transport for Bayesian Inverse Problems via Multilevel Monte Carlo

We consider the problem of Bayesian estimation associated to inverse problems governed by partial differential equations (PDEs). In most cases of practical interest, one must use numerical solvers to implement computational methods based on Monte Carlo methods. This inevitably leads to an adaptation of multilevel Monte Carlo (MLMC) methods to reduce computational efforts to achieve a pre-specified mean square error (MSE). MLMC is based on sampling coupled versions of Bayesian posteriors associated to increasingly precise numerical solves of the PDE. In this article we present a novel method to implement MLMC based upon sequential entropic optimal transport couplings learned with light Schrödinger bridges, and correct the transport with Metropolis--Hastings steps that preserve the pairing. We bound the mean square error associated to a version of our new estimation method and show, for an elliptic inverse problem, that to achieve a MSE of $\mathcal{O}(δ^2)$ ($δ>0$) one can have an optimal cost of $\mathcal{O}(δ^{-2})$. The results feature explicit bounds on the effect of the fitted transport and of the Metropolis--Hastings correction. From a numerical perspective, on elliptic, Darcy-flow and Navier-Stokes problems, the method reduces the variance of the most precise solver by a factor of five to ten and is faster than multilevel sequential Monte Carlo [arXiv:1503.07259] at tight accuracies.

math.NA↗

Affine invariant interacting Langevin dynamics in Markov chain importance sampling for rare event estimation

This work considers the framework of Markov chain importance sampling~(MCIS), in which one employs a Markov chain Monte Carlo~(MCMC) scheme to sample particles approaching the optimal distribution for importance sampling, prior to estimating the quantity of interest through importance sampling. In rare event estimation, the optimal distribution admits a non-differentiable log-density, thus gradient-based MCMC can only target a smooth approximation of the optimal density. We propose a new gradient-based MCIS scheme for rare event estimation, called affine invariant interacting Langevin dynamics for importance sampling~(ALDI-IS), in which the affine invariant interacting Langevin dynamics~(ALDI) is used to sample particles according to the smoothed zero-variance density. We establish a non-asymptotic error bound when importance sampling is used in conjunction with samples independently and identically distributed according to the smoothed optiaml density to estimate a rare event probability, and an error bound on the sampling bias when a simplified version of ALDI, the unadjusted Langevin algorithm, is used to sample from the smoothed optimal density. We show that the smoothing parameter of the optimal density has a strong influence and exhibits a trade-off between a low importance sampling error and the ease of sampling using ALDI. We perform a numerical study of ALDI-IS and illustrate this trade-off phenomenon on standard rare event estimation test cases.

math.ST↗

Insight from the Kullback--Leibler divergence into adaptive importance sampling schemes for rare event analysis in high dimension

We study two adaptive importance sampling schemes for estimating the probability of a rare event in the high-dimensional regime $d \to \infty$ with $d$ the dimension. The first scheme is the prominent cross-entropy (CE) method, and the second scheme, motivated by recent results, uses as auxiliary distribution a projection of the optimal auxiliary distribution on a lower dimensional subspace. In these schemes, two samples are used: the first one to learn the auxiliary distribution and the second one, drawn according to the learned distribution, to perform the final probability estimation. Contrary to the common belief that the sample size needs to grow exponentially in the dimension to make the estimator consistent and avoid the weight degeneracy phenomenon, we find that a polynomial sample size in the first learning step is enough. We prove this result assuming that the sought probability is bounded away from 0. For CE, insight is provided on the polynomial growth rate which remains implicit. In contrast, we study the second scheme in a simple computational framework assuming that samples from the conditional distribution are available. This makes it possible to show that the sample size only needs to grow like $rd$ with $r$ the effective dimension of the projection, which highlights the potential benefits of these projection methods.

math.ST↗