arXiv Science⌕ Search

arXiv subjects

Baojun Che

Publications and source records attributed to Baojun Che.

3 recordsLinked to original sources

Enhancing Exploration in Ensemble Kalman Inversion via Covariance Inflation and Projected Dropout

Ensemble Kalman inversion (EKI) is a derivative-free and parallelizable method for parameter estimation in Bayesian inverse problems involving expensive forward models. It adapts Kalman filtering by repeatedly assimilating the observation data through an artificial dynamical system with identity state evolution and the parameter-to-observation map as its observation operator. However, its performance can be limited by ensemble collapse and confinement to the affine span of the initial ensemble. We propose an exploration-enhanced EKI framework that combines multiplicative covariance inflation with a projected-dropout correction of the ensemble mean. Inflation helps maintain ensemble spread, while projected dropout enables the mean to explore directions beyond the initial affine span. For linear inverse problems, we provide a discrete-time, finite-ensemble analysis of the resulting method and prove the least-squares objective converges exponentially to its minimum in expectation. Within the initial ensemble subspace, the contraction factor is independent of the conditioning of the inverse problem, and the limiting ensemble covariance provides a low-rank representation of the posterior covariance. Experiments on ill-conditioned linear systems, 100-dimensional nonlinear benchmarks, and a PDE-constrained barotropic flow inverse problem demonstrate the effectiveness of the proposed method.

math.NA↗

Adaptive Exponential Integration for Stable Gaussian Mixture Black-Box Variational Inference

Black-box variational inference (BBVI) with Gaussian mixture families offers a flexible approach for approximating complex posterior distributions without requiring gradients of the target density. However, standard numerical optimization methods often suffer from instability and inefficiency. We develop a stable and efficient framework that combines three key components: (1) affine-invariant preconditioning via natural gradient formulations, (2) an exponential integrator that unconditionally preserves the positive definiteness of covariance matrices, and (3) adaptive time stepping to ensure stability and to accommodate distinct warm-up and convergence phases. The proposed approach has natural connections to manifold optimization and mirror descent. For Gaussian posteriors, we prove exponential convergence in the noise-free setting and almost-sure convergence under Monte Carlo estimation, rigorously justifying the necessity of adaptive time stepping. Numerical experiments on multimodal distributions, Neal's multiscale funnel, and a PDE-based Bayesian inverse problem for Darcy flow demonstrate the effectiveness of the proposed method.

cs.LG↗

Stable Derivative Free Gaussian Mixture Variational Inference for Bayesian Inverse Problems

This paper is concerned with the approximation of probability distributions known up to normalization constants, with a focus on Bayesian inference for large-scale inverse problems in scientific computing. In this context, key challenges include costly repeated evaluations of forward models, multimodality, and inaccessible gradients for the forward model. To address them, we develop a variational inference framework that combines Fisher-Rao natural gradient with specialized quadrature rules to enable derivative free updates of Gaussian mixture variational families. The resulting method, termed Derivative Free Gaussian Mixture Variational Inference (DF-GMVI), guarantees covariance positivity and affine invariance, offering a stable and efficient framework for approximating complex posterior distributions. The effectiveness of DF-GMVI is demonstrated through numerical experiments on challenging scenarios, including distributions with multiple modes, infinitely many modes, and curved modes in spaces with up to 100 dimensions. The method's practicality is further demonstrated in a large-scale application, where it successfully recovers the initial conditions of the Navier-Stokes equations from solution data at positive times.

cs.LG↗