arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2609.26653

Distributed Proximal Stein Variational Gradient Descent Algorithm for Large-scale Bayesian Inference in Traveltime Tomography

Akshay Vishwakarma·Kamal Aghazade·Ali Siahkoohi·Ali Gholami
View original source ↗Read source document ↗Export metadata ↓

Abstract

We present a distributed framework for large-scale Bayesian inverse problems governed by the eikonal equation, with a specific focus on seismic traveltime tomography. Traditional deterministic approaches often fail to provide the uncertainty quantification (UQ) necessary for ill-posed problems, while conventional Bayesian sampling methods such as Markov chain Monte Carlo (MCMC) suffer from the curse of dimensionality and slow convergence in high-dimensional model spaces. The proposed framework addresses these challenges through a three-tier computational strategy. First, we utilize the Fast Marching Method (FMM) to solve the eikonal equation, ensuring high numerical accuracy. Second, we reformulate the global tomographic objective into a decentralized consensus form, allowing the inversion to be decomposed into independent subproblems solved in parallel via the Alternating Direction Method of Multipliers (ADMM). This architecture eliminates the need for the explicit construction of large-scale sensitivity matrices, significantly reducing the memory footprint for 3D surveys. Finally, we integrate Stein Variational Gradient Descent (SVGD) within the ADMM workers to perform approximate posterior sampling. By evolving a set of model particles along a functional gradient direction that balances data-fitting forces with a repulsive kernel-based diversity force, we obtain an ensemble from which posterior summaries are computed. We derive a data-space Gauss-Newton update using the Woodbury matrix identity to further accelerate the particle evolution in large-scale 3D problems. Numerical experiments on complex 2D and 3D models demonstrate that the algorithm achieves stable convergence, produces high-fidelity velocity reconstructions, and provides posterior uncertainty maps.

Explore related subjects

physics.geo-phcs.NAmath.NAphysics.comp-ph

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Akshay Vishwakarma, Kamal Aghazade, Ali Siahkoohi, Ali Gholami. 2026-09-22. Distributed Proximal Stein Variational Gradient Descent Algorithm for Large-scale Bayesian Inference in Traveltime Tomography. https://arxiv.org/abs/2609.26653

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Parameter-Efficient Adaptation of Pre-Trained Vision Foundation Models for Active and Passive Seismic Data Denoising

The demand for high-resolution subsurface imaging and continuous Earth monitoring has driven rapid growth in active and passive seismic data from dense geophone deployments, distributed acoustic sensing (DAS) arrays, and large-scale 2D and 3D surveys. This expansion makes complex noise suppression increasingly challenging, especially when signal fidelity must be preserved. Conventional supervised deep learning methods are often task-specific, require large paired datasets, and can suffer from domain shift under new acquisition conditions. Foundation models offer a promising alternative, but pre-training seismic foundation models from scratch requires massive domain-specific data and substantial computation. We propose an efficient framework that repurposes general-purpose Vision Foundation Models (VFMs) for geophysical tasks through Parameter-Efficient Fine-Tuning. The architecture uses a pre-trained VFM, a DINOv3 encoder, adapted with Low-Rank Adaptation (LoRA) to enable effective feature adaptation with few additional parameters. To improve robustness under unseen field conditions without ground truth, we introduce a kurtosis-guided unsupervised test-time adaptation module that updates only LoRA parameters during inference. This module self-calibrates the model to site-specific noise by identifying information-rich regions via kurtosis and performing self-training without labeled data. Experiments on public exploration seismic images and DAS vertical seismic profiling data from the Utah FORGE site show that the framework matches or outperforms domain-specific models. Tests on unseen cross-site data from a land survey in China and the Groß Schönebeck geothermal site in Germany further demonstrate strong generalization and effective signal-noise separation. These results highlight the potential of adapting pre-trained VFMs to data-intensive problems in exploration seismology.

physics.geo-ph↗
arXiv2026

Shallow-to-deep velocity model building via diffusion models-Part I: Method and Proof of concept

Seismic velocity model building (VMB) is fundamental for understanding subsurface structures. Traditional methods demand high-quality starting models and, also, remain limited in resolution in coverage and computationally intensive. Recent generative diffusion model-based approaches capture statistical priors to support traditional inversion methods, but these approaches do not account for the top to bottom progression of information (layer stripping) involved in surface recorded data, where deep velocity information depends on the shallow. To address this issue, we propose a depth-progressive diffusion framework that constructs velocity models incrementally from shallow to deep by propagating prior information. Our method trains on paired shallow-deep velocity patches with variable overlap and explicit depth encoding, integrating multiple geophysical constraints including well logs and seismic images (representing structural information). During inference, we synthesize overlapping depth slices using a progressive algorithm and merge them with Gaussian-weighted blending to eliminate boundary artifacts. This approach leverages both learned geological distributions and observed shallow priors while providing uncertainty quantification. Extensive numerical experiments on in-distribution tests and an out-of-distribution test demonstrate excellent VMB accuracy with a strong correlation between predicted uncertainty and actual errors. As a proof of concept, this part I employs idealized structural constraints derived from vertical reflectivity to validate the methodological framework. The companion paper (Part II) extends the approach to realistic structural constraints relying on migrated images with field data applications.

physics.geo-ph↗
arXiv2026

Shallow-to-deep velocity model building via diffusion models-Part II: Realistic scenarios

Full-waveform inversion (FWI) requires accurate initial velocity models to avoid cycle-skipping, but constructing such models remains challenging in practice. Building on the depth-progressive diffusion framework introduced in Part~I, which relied on idealized reflectivity constraints, this work adapts the methodology to realistic exploration scenarios. We replace perfect structural information with migration-derived attributes extracted from seismic images, and introduce smooth background velocity models from tomography as additional conditioning inputs. The framework jointly leverages background/migration velocity, migrated structural information, and sparse well measurements to synthesize high-resolution velocity models through depth-progressive generation. Validation on synthetic examples demonstrates superior accuracy compared to conventional interpolation and alternative deep learning methods, with generated models successfully initializing FWI and mitigating cycle-skipping even in complex geological structures. Field data confirms practical applicability: despite training on synthetic data, the method generalizes effectively to field conditions, producing velocity models with synthetic data response that nearly match observed seismic data. As a result, this framework establishes a practical pathway to deploy generative diffusion models for velocity model building under realistic constraints.

physics.geo-ph↗