arXiv ScienceSearch

arXiv · 2310.10602

Physics-informed neural wavefields with Gabor basis functions

Abstract

Recently, Physics-Informed Neural Networks (PINNs) have gained significant attention for their versatile interpolation capabilities in solving partial differential equations (PDEs). Despite their potential, the training can be computationally demanding, especially for intricate functions like wavefields. This is primarily due to the neural-based (learned) basis functions, biased toward low frequencies, as they are dominated by polynomial calculations, which are not inherently wavefield-friendly. In response, we propose an approach to enhance the efficiency and accuracy of neural network wavefield solutions by modeling them as linear combinations of Gabor basis functions that satisfy the wave equation. Specifically, for the Helmholtz equation, we augment the fully connected neural network model with an adaptable Gabor layer constituting the final hidden layer, employing a weighted summation of these Gabor neurons to compute the predictions (output). These weights/coefficients of the Gabor functions are learned from the previous hidden layers that include nonlinear activation functions. To ensure the Gabor layer's utilization across the model space, we incorporate a smaller auxiliary network to forecast the center of each Gabor function based on input coordinates. Realistic assessments showcase the efficacy of this novel implementation compared to the vanilla PINN, particularly in scenarios involving high-frequencies and realistic models that are often challenging for PINNs.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Tariq Alkhalifah, Xinquan Huang. 2023-10-16. Physics-informed neural wavefields with Gabor basis functions. https://doi.org/10.1016/j.neunet.2024.106286

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Three dimensional non-singular mollified elastic dislocation theory for extended width fault zones and inhomogeneous boundary element models

Classical elastic dislocation theory (CEDT) has two challenges when applied to faulting problems: 1) fictitious on-fault stresses not defined by ordinary integration and 2) the geometric unreality of infinitely thin fault zones. We show that both can be resolved by a mollified elastic dislocation theory (MEDT) built on Cortez blob (Cortez, 2001) mollified displacement discontinuity Green's functions, which represent deformation across spatially distributed fault zones of finite scale epsilon and produce singularity-free displacements and stresses everywhere. Analytical integration of the mollified source solution over arbitrary planar triangular elements is done with AI, and the resulting closed-form solutions allow for the calculation of non-singular stresses across geometrically complex fault systems. Further, we demonstrate the decoupling of the fault-zone width scale epsilon from the mesh length scale h, the elasticity analog of a result established for regularized viscous flow Stokeslets (Ferranti and Cortez, 2024). We use these mollified kernels to demonstrate numerically stable collocation boundary element models including spatially extended fault zones, material property variations and non-planar topography.

physics.geo-ph

Identifying the approach of a major earthquake

By analyzing the seismicity in natural time and studying the evolution of the fluctuations of the entropy change of seismicity under time reversal for various scales of different length i (number of events), we can identify the approach of a major earthquake (EQ) occurrence. The current investigation is extended from 1984 until now for the seismicity in Japan.

physics.geo-ph

ADEPTS: An auto-differentiable framework for time-dependent nonlinear thermo-chemical mantle convection inversion

Time-dependent mantle-dynamics inversion must address the high dimensionality of the initial state, nonlinear rheology, and gradient propagation through long-term thermo-mechanical evolution. We develop ADEPTS, a two-dimensional staggered-grid finite-difference framework for mantle-dynamics inversion based on automatic differentiation. The forward model solves incompressible Stokes flow, temperature advection-diffusion, and compositional advection with temperature- and strain-rate-dependent viscosity and plastic yielding. For the nonlinear Stokes system, we compare two gradient strategies: unrolled differentiation through a fixed number of Picard iterations and implicit differentiation of the converged discrete residual equations. Numerical experiments show that unrolled differentiation remains stable even when the nonlinear solve is not fully converged, whereas implicit differentiation requires sufficiently accurate nonlinear solutions; otherwise gradient consistency and optimization convergence deteriorate. With sufficiently converged solves, implicit differentiation recovers accurate gradients and reconstruction quality comparable to unrolled differentiation. Joint thermo-chemical twin experiments show that ADEPTS can simultaneously recover a high-dimensional initial temperature field and low-dimensional physical parameters, including compositional density, reference viscosity, and stress exponent, while fitting final-time temperature, surface horizontal velocity, and surface normal stress. These results demonstrate the feasibility of differentiable time-dependent mantle-dynamics inversion and clarify the different convergence requirements of unrolled and implicit differentiation.

physics.geo-ph