arXiv ScienceSearch

arXiv subjects

Bangti Jin

Publications and source records attributed to Bangti Jin.

At least 19 recordsLinked to original sources

Numerical Analysis of Space-Time Dependent Source Identification in Subdiffusion Equations

In this work, we propose an easy-to-implement fixed-point algorithm for reconstructing a space-time dependent source in a subdiffusion model from lateral boundary measurements. The numerical scheme combines a Galerkin finite element method for spatial discretization with a finite difference method for temporal discretization. We establish the linear convergence of the fixed-point iteration and derive an error bound that depends explicitly on the discretization parameters and the noise level. The error analysis relies on stability properties of the continuous inverse problem and technical estimates for the associated direct problem with limited-regularity data. Numerical experiments are presented to support and complement the theoretical analysis.

math.NA

On the Uniqueness of a Nonlinear Discrete Calderón Problem

The discrete Calderón problem aims at recovering the conductivity on the edges of a graph from boundary measurements, encoded by the discrete Dirichlet-to-Neumann (DtN) map. The problem has been intensively studied in the linear case on square lattices since the seminal works of Curtis and Morrow. In this work, we investigate a nonlinear analogue of the discrete Calderón problem for a semilinear second-order elliptic equation on square lattices. We establish three uniqueness results for the conductivity recovery. First, we show that conductivity-dependent corner excitations allow a layer-by-layer reconstruction of the conductivity. Second, we study the linearization of the nonlinear DtN map at an arbitrary background boundary datum and prove that the conductivity and the background potential are uniquely determined by one pair of nonlinear Cauchy data and the linearized DtN map. Third, we show that the linearized data can be replaced by finitely many nonlinear measurements, which uniquely determine the conductivity.

math.AP

Early stopping of stochastic variance reduced gradient for linear inverse problems by the discrepancy principle

Stochastic variance reduced gradient (SVRG) is a variant of stochastic gradient descent and is a promising iterative method for solving large-scale inverse problems. Nevertheless, the development of theoretically grounded a posteriori stopping rules for SVRG remains an open challenge. In this work, we provide a convergence analysis of SVRG equipped with the discrepancy principle, the most well-known a posteriori stopping rule, for solving a class of linear inverse problems in Hilbert spaces. We establish the regularizing property of SVRG, and moreover, under suitable source conditions, we derive convergence rates of SVRG iterates. To the best of our knowledge, these are the first convergence rate results of any stochastic iterative method for inverse problems under the a posteriori stopping rule. The theoretical findings are supported by numerical experiments.

math.NA

Error Analysis of the Inverse Conductivity Problem with Scattered Measurements

In this work, we investigate the inverse problem of recovering the conductivity coefficient in an elliptic equation from noisy measurements collected at finitely many deterministic scattered points in the domain $Ω$, and corrupted by random noise. Inspired by the regularity analysis, we propose a numerical scheme based on the regularized least-squares formulation with a $W^{1,4}(Ω)$ penalty, and discretize the regularized problem using the Galerkin finite element method with continuous piecewise linear elements. Under suitable assumptions on the problem data, we provide an error analysis of the regularized solution and its Galerkin approximation. We establish $L^2(Ω)$ error bounds in a high-probability sense, which depend explicitly on the regularization parameter $γ$, the number $n$ of data points and the mesh size $h$. We also present numerical experiments to illustrate the theoretical findings.

math.NA

On the extreme eigenvalues of the Gram Matrix in Physics-Informed Neural Networks for the Poisson Equation

The smallest and largest eigenvalues of the Gram matrix induced by the differential neural tangent kernel (DNTK) play a pivotal role in the analysis of over-parameterized PINNs trained by gradient type algorithms. However, a theoretical analysis of the extreme eigenvalues remains completely absent due to the challenge posed by the presence of multiple differential operators. In this work, we provide explicit lower and upper bounds for the extreme eigenvalues of the infinite DNTK matrix for the Poisson equation with the Dirichlet boundary condition for two-layer RePU neural networks without the bias term. The setting is fairly general with respect to the sampling points and input dimension \(d\): \(δ\)-separated and additionally \(d\geq 3\) when deriving the lower bound of the smallest eigenvalue. These results extend that for the neural tangent kernel, and to the best of our knowledge, represent the first results on the spectrum of the DNTK.

math.NA

Stability and Reconstruction of a Nonlinearity in a Parabolic Equation from Partial Boundary Data

In this work, we investigate the inverse problem of determining a semilinear term in a nonlinear parabolic equation from one single boundary flux measurement taken on an arbitrary subset of the boundary. More precisely, we address both uniqueness and stability issues of the inverse problem and establish new Hölder-type stability estimates. The Hölder exponent depends explicitly on the measurement configuration as well as on regularity properties of the semilinear term. The analysis relies on a novel approach based on the derivation of a suitable integral identity involving solutions of the associated adjoint equation. This allows reformulating the inverse problem as an inverse source problem with a sign-changing source term. The main results are obtained by combining fundamental properties of parabolic equations, including maximum principle and appropriate energy estimates. Finally, we complement the theoretical analysis with an iterative reconstruction algorithm inspired by inverse source problems, and illustrate its accuracy on several numerical experiments.

math.AP

Stability of Electrical Impedance Tomography with Anisotropies and its Application to the Deep Caldeón Method

In this work, we establish new conditional Lipschitz stability results for electrical impedance tomography (EIT) with anisotropies, of recovering the conductivity in a conformal class of a known anisotropic conductivity in both two- and multi-dimensional cases. Then we employ the stability theory to understand the property of the deep Calderón method, one deep learning-based technique for image reconstruction in EIT that has shown promising empirical results, but still lacks theoretical underpinnings. Specifically, we relate the stability theory to the robustness of the method with the proper choice of the training data, and present numerical results in two-dimension to complement the theoretical analysis.

math.AP

The Differential Neural Tangent Kernel and Its Positivity

The Neural Tangent Kernel (NTK) is one powerful tool for analyzing the training dynamics of neural networks in the over-parameterized regime. Recently, the theoretical framework has been extended to physics-informed neural networks (PINNs) for solving linear PDEs, one highly popular class of neural PDE solvers. In the analysis, the positivity of the associated NTK plays a fundamental role. However, establishing the positivity of the NTK for PINNs is highly challenging, due to the presence of multiple differential operators. In this work, we propose a new theoretical framework, called Differential Neural Tangent Kernel (DNTK), for analyzing PINNs through the lens of the NTK, and establish the positivity of the infinite width DNTK for both shallow and deep neural networks for a wide class of activation functions, including RePU and smooth but non-polynomial activations, for all linear differential operators. These theoretical results lay the foundation for the analysis of gradient type algorithms for training PINNs.

cs.LG

Convergence of Stochastic Gradient Methods for Wide Two-Layer Physics-Informed Neural Networks for the Poisson Equation

Physics informed neural networks (PINNs) represent a very popular class of neural solvers for partial differential equations. In practice, one often employs stochastic gradient descent type algorithms to train the neural network. Therefore, the convergence guarantee of stochastic gradient descent is of fundamental importance. In this work, we establish the linear convergence of stochastic gradient descent / flow in training over-parameterized two layer PINNs with a general class of activation functions for solving one model second-order elliptic problem, i.e., the Poisson equation, in the sense of high probability. These results extend the existing result [20] in which gradient descent was analyzed. The challenge of the analysis lies in handling the dynamic randomness introduced by stochastic optimization methods. The key of the analysis lies in ensuring the positive definiteness of suitable Gram matrices during the training. The analysis sheds insight into the dynamics of the optimization process, and provides guarantees on physics informed neural networks trained by stochastic algorithms.

cs.LG

Shallow neural network yields regularization for ill-posed inverse problems

In this paper, we develop a regularization theory for neural network approximations of general ill-posed operator equations with noisy data. Within the framework of iterative regularization, we introduce two expanding neural network methods (ENNs) under different a priori assumptions on the exact solution. Instead of prescribing a fixed architecture, ENNs adaptively select the number of neurons through an a posteriori stopping rule, so that the selected network size serves as a regularization parameter balancing approximation accuracy and stability with respect to data noise. We prove the regularization properties of the proposed ENNs and establish quantitative relationships between the selected network size and the noise level. Within the framework of variational regularization, we propose a neural network-based Tikhonov scheme and derive both convergence and convergence-rate results under mild assumptions. The resulting estimates account for the noise level, the network size, and the underlying smoothness expressed through general variational source conditions, thereby allowing greater flexibility than existing results. Numerical experiments demonstrate the effectiveness and robustness of the proposed algorithms. In particular, they show that, for highly noisy data, relatively small network architectures can already produce stable reconstructions, whereas excessively large architectures may degrade stability due to overfitting.

math.NA

On the convergence of stochastic variance reduced gradient for linear inverse problems

Stochastic variance reduced gradient (SVRG) is an accelerated version of stochastic gradient descent based on variance reduction, and is promising for solving large-scale inverse problems. In this work, we analyze SVRG and a regularized version that incorporates a priori knowledge of the problem, for solving linear inverse problems in Hilbert spaces. We prove that, with suitable constant step size schedules and regularity conditions, the regularized SVRG can achieve optimal convergence rates in terms of the noise level without any early stopping rules, provided that the truncation level is chosen suitably, and standard SVRG is also optimal for problems with nonsmooth solutions under a priori stopping rules. The analysis is based on an explicit error recursion and suitable a priori estimates on the inner loop updates with respect to the anchor point. Numerical experiments are provided to complement the theoretical analysis.

math.NA

Stability Estimates for the Inverse Problem of Reconstructing Point sources in Parabolic Equations

In this work, we investigate the stability issue of the inverse problem of determining the locations and time-dependent amplitudes of point sources in a parabolic equation with a non-self adjoint elliptic operator from boundary observations. We derive different stability estimates for determining the locations and the amplitudes of the sources in the space, the plane as well as in dimension one. The analysis employs a novel approach that combines several different arguments, including the improved regularity of the solutions, the application of Carleman estimates, time extension of solutions, and construction of explicit solutions to the adjoint equations. Further we provide numerical reconstructions to complement the theoretical findings.

math.AP

Identification of a Point Source in the Heat Equation from Sparse Boundary Measurements

In this work we investigate the inverse problem of recovering one point source in the heat equation from sparse boundary measurement, i.e., the flux data at several points on the boundary. We prove the unique recovery of the location and piecewise constant in time amplitude when the domain is the unit ball in $\mathbb{R}^d$ ($d\geq2$), and the unique recovery of the location and compactly supported amplitude when the domain is simply connected, smooth and bounded in $\mathbb{R}^2$, under mild conditions on the observational points. The proof combines distinct analytical tools, including the representation of the flux data via Laplacian eigenfunctions on the unit ball, a detailed analysis of the properties of the heat and Poisson kernels, as well as methods drawn from complex analysis. Further we present several numerical experiments to illustrate the feasibility of the recovery from sparse boundary data.

math.AP

On the uniqueness of the discrete Calderon problem on multi-dimensional lattices

In this work, we investigate the discrete Calderón problem on grid graphs of dimension three or higher, formed by hypercubic structures. The discrete Calderón problem is concerned with determining whether the discrete Dirichlet-to-Neumann (DtN) operator, which links boundary potentials to boundary current responses, can uniquely identify the conductivity values on the graph edges. We provide an affirmative answer to the question, thereby extending the classical uniqueness result of Curtis and Morrow for two-dimensional square lattices. The proof employs a novel slicing technique that decomposes the problem into lower-dimensional components. Additionally, we support the theoretical finding with numerical experiments that illustrate the effectiveness of the approach.

math-ph

Unique Determination of Variable Order in Subdiffusion from a Single Measurement

We study the inverse problem of recovering a spatially dependent variable order in a time-fractional diffusion model from the boundary flux measurement generated by a single boundary excitation. It arises in the identification of heterogeneous media in anomalous diffusion processes. In this work, we establish several new uniqueness results for the inverse problem in the case of piecewise constant variable orders, without any monotonicity condition. The analysis follows a new approach that combines properties of harmonic functions, a linearization technique in the Laplace domain, and tools from complex, asymptotic, and geometrical analysis. In addition, we weaken the regularity assumptions on the problem data and extend the analysis of previous contributions to higher-dimensional settings.

math.AP

On the contraction rate of the posterior distribution for nonlinear PDE parameter identification

In this work, we investigate the estimation of a parameter $f$ in PDEs using Bayesian procedures, and focus on posterior distributions constructed using Gaussian process priors, and its variational approximation. We establish contraction rates for the posterior distribution and the variational approximation in the regime of low-regularity parameters. The main novelty of the study lies in relaxing the condition that the ground truth parameter must lie in the reproducing kernel Hilbert space of the Gaussian process prior, which is commonly imposed in existing studies on posterior contraction rate analysis [14,40,44]. The analysis relies on a delicate approximation argument that suitably balances various error sources. We illustrate the general theory on three nonlinear inverse problems for PDEs.

math.ST

Stochastic Gradient Descent for Nonlinear Inverse Problems in Banach Spaces

Stochastic gradient descent (SGD) and its variants are widely used and highly effective optimization methods in machine learning, especially for neural network training. By using a single datum or a small subset of the data, selected randomly at each iteration, SGD scales well to problem size and has been shown to be effective for solving large-scale inverse problems. In this work, we investigate SGD for solving nonlinear inverse problems in Banach spaces through the lens of iterative regularization. Under general assumptions, we prove almost sure convergence of the iterates to the minimum distance solution and show the regularizing property in expectation under an a priori stopping rule. Further, we establish convergence rates under the conditional stability assumptions for both exact and noisy data. Numerical experiments on Schlieren tomography and electrical impedance tomography are presented to show distinct features of the method.

math.NA

Unique and Stable Recovery of Space-Variable Order in Multidimensional Subdiffusion

In this work we investigate the unique identifiability and stable recovery of a spatially dependent variable-order in the subdiffusion model from the boundary flux measurement. We establish several new unique identifiability results from the observation at one point on the boundary without / with the knowledge of medium properties, and a conditional Lipschitz stability estimate when the observation is available on the whole boundary. The analysis crucially employs resolvent estimates in the $L^r(Ω)$ ($r>d$) spaces, solution representation in the Laplace domain and novel asymptotic expansions of the Laplace transform of the boundary flux at $p= 0$ and $p=1$.

math.AP