arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2610.27434

Beyond exponential tilting: sharp asymptotics and improved importance sampling for rare events

Mingxin Li·Hans Reimann·Timo Schorlepp·Georg Stadler
View original source ↗Read source document ↗Export metadata ↓

Abstract

A classical approach for importance sampling (IS) of a rare event is to tilt the measure using its large deviation minimizer, thereby shifting the proposal mean towards the event set. While this tilt is log-efficient, we show that the coefficient of variation of the resulting estimator still grows like $\varepsilon^{-1/4}$ in the small-noise limit $\varepsilon\downarrow0$. Motivated by sharp large deviation asymptotics and the local geometry of the event set at the minimizer, we propose improvements using a control variate or an anisotropic, non-Gaussian proposal. We prove, up to truncations that hold with high probability, and confirm empirically in high-dimensional examples, that the former bounds the coefficient of variation and the latter makes it vanish, so that a bounded number of samples suffices. Our analysis addresses both the coefficient of variation of the different proposals and their necessary and sufficient sample size based on the Kullback--Leibler divergence of the IS target from the proposal; both yield the same rates in $\varepsilon$. We demonstrate the resulting samplers, including a variant that blends the classical and the new proposal across noise levels, for a stochastic Korteweg--de Vries equation with thousands of random inputs.

Explore related subjects

stat.COcs.NAmath.NAmath.PRmath.STstat.TH

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Mingxin Li, Hans Reimann, Timo Schorlepp, Georg Stadler. 2026-10-20. Beyond exponential tilting: sharp asymptotics and improved importance sampling for rare events. https://arxiv.org/abs/2610.27434

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Neural Posterior Estimation for Spatial Individual-Level Epidemic Models

Spatial individual-level models (ILMs) provide a flexible framework for modeling infectious disease transmission across populations with known locations. Bayesian inference for these models relies on Markov chain Monte Carlo (MCMC), which requires repeated likelihood evaluation and, when parts of the epidemic trajectory are unobserved, data-augmented sampling over high-dimensional latent variables. This computational cost limits the applicability of MCMC to large populations and to settings requiring inference across multiple outbreaks. We propose using neural posterior estimation (NPE) for amortized Bayesian inference in spatial ILMs. NPE trains a conditional normalizing flow on simulated data to approximate the posterior directly, bypassing likelihood evaluation at inference time. We compare two embedding architectures: a convolutional neural network (CNN) operating on the population-level incidence curve and a graph neural network (GNN) operating on individual-level infection and location data. In a simulation study under full observation, stochastic removals, and partial observation, both variants achieve empirical coverage close to the nominal level, with the GNN embedding yielding lower error and narrower credible intervals for the spatial transmission parameters. Data-augmented MCMC is the most accurate when its chains converge, and GNN-NPE is closer to MCMC than CNN-NPE at a small fraction of the per-epidemic cost of MCMC. We apply the framework to the observed 2001 UK foot-and-mouth disease outbreak on 1,177 farms, where MCMC with the exact likelihood provides a reference posterior. Both NPE variants recover the reproduction number estimated by MCMC. GNN-NPE gives a narrower posterior for the spatial decay of transmission than CNN-NPE but is shifted relative to the MCMC reference.

stat.CO↗
arXiv2026

Geometry-informed importance sampling for rare events

We propose GeoIS, a new importance sampling method for estimating rare event probabilities for an underlying Gaussian distribution that exploits asymptotic theory and local event geometry. The proposal distribution is a mixture of two components. The first component draws a Gaussian along the boundary near the instanton and adds to it an exponentially distributed shift into the rare event. This component is derived from the known asymptotic approximation to the optimal zero-variance proposal distribution. The second mixture component is designed to cover missing event mass due to boundary-approximation mismatch, thereby preserving unbiasedness. We rigorously analyze this sampling strategy's performance as a function of event geometry, dimension, rarity level, and number $N$ of importance samples. Under explicit and relatively mild conditions on the former three features, we prove that the squared relative error of GeoIS is bounded by $c/N$ with high probability, for an absolute constant $c$. We implement our method numerically in several examples, including a diffusion PDE problem. The numerical experiments exhibit the qualitative dependence on geometry, dimension, rarity and sample size predicted by the theory, and show that GeoIS markedly outperforms importance sampling methods that use a fully Gaussian proposal distribution.

stat.CO↗
arXiv2026

Practical Advantages of Online Conformal Prediction for Data Streams

Full conformal prediction offers finite-sample marginal coverage guarantees under exchangeability, but exact computation can be costly, while its classical guarantees do not directly extend to non-stationary data streams. We compare four sequential conformal regression procedures with a weighted full-conformal benchmark in terms of empirical coverage, prediction interval width, and computational cost. The procedures combine ordinary or forgetting-factor least squares with uniform or exponentially weighted empirical residual quantiles, or with online gradient-based quantile tracking. Experiments cover an independent and identically distributed control, two synthetic distribution-shift scenarios, and four real-world data streams. Adapting the regression model as well as the conformal threshold substantially improves the coverage--width tradeoff under drift. The quantile-tracking procedure requires $O(p^2)$ time and memory per observation, independently of stream length, although its coverage can deteriorate after abrupt changes. These results illustrate the practical tradeoffs between predictor adaptation, uncertainty quantification, and computational resources.

stat.CO↗