arXiv ScienceSearch

arXiv · 2504.09075

Parallel Seismic Data Processing Performance with Cloud-based Storage

Abstract

This article introduces a general processing framework to effectively utilize waveform data stored on modern cloud platforms. The focus is hybrid processing schemes where a local system drives processing. We show that downloading files and doing all processing locally is problematic even when the local system is a high-performance compute cluster. Benchmark tests with parallel processing show that approach always creates a bottleneck as the volume of data being handled increases with more processes pulling data. We find a hybrid model where processing to reduce the volume of data transferred from the cloud servers to the local system can dramatically improve processing time. Tests implemented with Massively Parallel Analysis System for Seismology (MsPASS) utilizing Amazon Web Service's Lamba service yield throughput comparable to processing day files on a local HPC file system. Given the ongoing migration of seismology data to cloud storage, our results show doing some or all processing on the cloud will be essential for any processing involving large volumes of data.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Sasmita Mohapatra, Weiming Yang, Zhengtang Yang, Chenxiao Wang, Jinxin Ma, Gary L. Pavlis, Yinzhi Wang. 2025-09-02. Parallel Seismic Data Processing Performance with Cloud-based Storage. https://arxiv.org/abs/2504.09075

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Three dimensional non-singular mollified elastic dislocation theory for extended width fault zones and inhomogeneous boundary element models

Classical elastic dislocation theory (CEDT) has two challenges when applied to faulting problems: 1) fictitious on-fault stresses not defined by ordinary integration and 2) the geometric unreality of infinitely thin fault zones. We show that both can be resolved by a mollified elastic dislocation theory (MEDT) built on Cortez blob (Cortez, 2001) mollified displacement discontinuity Green's functions, which represent deformation across spatially distributed fault zones of finite scale epsilon and produce singularity-free displacements and stresses everywhere. Analytical integration of the mollified source solution over arbitrary planar triangular elements is done with AI, and the resulting closed-form solutions allow for the calculation of non-singular stresses across geometrically complex fault systems. Further, we demonstrate the decoupling of the fault-zone width scale epsilon from the mesh length scale h, the elasticity analog of a result established for regularized viscous flow Stokeslets (Ferranti and Cortez, 2024). We use these mollified kernels to demonstrate numerically stable collocation boundary element models including spatially extended fault zones, material property variations and non-planar topography.

physics.geo-ph

Identifying the approach of a major earthquake

By analyzing the seismicity in natural time and studying the evolution of the fluctuations of the entropy change of seismicity under time reversal for various scales of different length i (number of events), we can identify the approach of a major earthquake (EQ) occurrence. The current investigation is extended from 1984 until now for the seismicity in Japan.

physics.geo-ph

ADEPTS: An auto-differentiable framework for time-dependent nonlinear thermo-chemical mantle convection inversion

Time-dependent mantle-dynamics inversion must address the high dimensionality of the initial state, nonlinear rheology, and gradient propagation through long-term thermo-mechanical evolution. We develop ADEPTS, a two-dimensional staggered-grid finite-difference framework for mantle-dynamics inversion based on automatic differentiation. The forward model solves incompressible Stokes flow, temperature advection-diffusion, and compositional advection with temperature- and strain-rate-dependent viscosity and plastic yielding. For the nonlinear Stokes system, we compare two gradient strategies: unrolled differentiation through a fixed number of Picard iterations and implicit differentiation of the converged discrete residual equations. Numerical experiments show that unrolled differentiation remains stable even when the nonlinear solve is not fully converged, whereas implicit differentiation requires sufficiently accurate nonlinear solutions; otherwise gradient consistency and optimization convergence deteriorate. With sufficiently converged solves, implicit differentiation recovers accurate gradients and reconstruction quality comparable to unrolled differentiation. Joint thermo-chemical twin experiments show that ADEPTS can simultaneously recover a high-dimensional initial temperature field and low-dimensional physical parameters, including compositional density, reference viscosity, and stress exponent, while fitting final-time temperature, surface horizontal velocity, and surface normal stress. These results demonstrate the feasibility of differentiable time-dependent mantle-dynamics inversion and clarify the different convergence requirements of unrolled and implicit differentiation.

physics.geo-ph