arXiv Science⌕ Search

arXiv subjects

Andreas Rupp

Publications and source records attributed to Andreas Rupp.

At least 19 recordsLinked to original sources

Quantitative approximation for Fourier neural operators in controlled ordinary differential equations

Fourier neural operators (FNOs) avoid the curse of parametric complexity when approximating the solution operator of certain partial differential equations (PDEs). While recent studies primarily focus on PDEs, in this article we derive upper error bounds for approximating the solution operator of controlled ordinary differential equations (CODEs) $\dot{y}=f(y,u)$ using a FNO. Under a Carathéodory setting and suitable regularity assumptions, including a smallness condition, we prove that the size of the FNO grows at most algebraically in $1/\varepsilon$, namely like $\varepsilon^{-(1+d/(2(s-1)))}$ up to logarithmic factors for GELU networks, and is thus sub-quadratic for sufficiently smooth $f$, where $d=1+n_y+n_u$ and $s$ denotes the Sobolev regularity of $f$. Our proof is based on emulating the Picard iteration through the layers of the FNO while exploiting the differentiation formula of the discrete Fourier transform. This result contributes to the quantitative approximation theory of FNOs for physically motivated problems and provides a theoretical foundation for leveraging a FNO as efficient forward surrogate for the solution operator of CODEs, especially in inverse parameter estimation where repeated evaluations of the forward operator are needed.

math.NA↗

Conservative Finite Element Methods for Kirchhoff-Type Equations

We construct and analyse a fully discrete scheme for a Kirchhoff-type nonlinear integro-differential equation in two spatial dimensions with time-dependent coefficients. The scheme combines a symmetric three-layer time discretization of Crank--Nicolson type with a conforming finite element method of arbitrary polynomial degree $p$ and a Picard iteration for the nonlinearity. We prove that the Picard iteration is well defined and, that the iterates converge to the Ritz projection of the exact solution measured in fractional-power norms of the discrete Laplacian. Running the same energy argument in the unshifted norms, and under the same hypotheses, we then obtain the optimal order $\mathcal{O} ( h^{p+1} + τ^2 )$ in $L^2$ and $\mathcal{O} ( h^{p} + τ^2 )$ in $H^1$ for the full error. For the homogeneous problem with constant coefficients, the exact solution of the scheme moreover preserves a discrete energy identically. Numerical experiments with manufactured solutions reproduce the predicted second order in time and the full spatial order $h^{p+1}$ in the $L^2$-norm.

math.NA↗

A finite element exterior-to-interior reconstruction in the fractional conductivity inverse problem

We develop a regularized finite element method for the fractional conductivity equation, recovering the conductivity on an exterior observation region from noisy Dirichlet-to-Neumann measurements and using this reconstruction to determine the interior conductivity. Mesh-localized inputs and mass-lumped Tikhonov regularization discretize the exterior determination principle of Covi--Railo--Zimmermann (2026, Calc. Var. PDE). We prove exterior \(L^2\)- and \(L^\infty\)-convergence with error estimates, including the logarithmic correction at the critical Hölder exponent. The exterior reconstruction enables the Liouville reduction to the Calderón problem for the fractional Schrödinger equation. Separated measurements recover the interior potential, after which overlapping measurements determine the exterior potential tail. Together with the recovered exterior conductivity, the tail supplies the exterior Cauchy data for a Tikhonov-regularized finite element least-squares continuation. We prove \(H^s\)-convergence of the transformed conductivity and \(L^2\)-convergence of the interior conductivity, together with logarithmic state-bias and conductivity error estimates for full observation spaces. The admissible reconstructions remain uniformly positive and bounded. We present one- and two-dimensional numerical experiments illustrating the accuracy of the exterior and interior reconstructions and their sensitivity to measurement noise and discretization.

math.NA↗

Conservative Three-Layer Schemes for Kirchhoff-Type Equations

We study a Kirchhoff-type nonlinear integro-differential equation in two spatial dimensions whose coefficients are allowed to depend on time, and we construct conservative discretizations in time for the associated initial--boundary value problem. We consider two symmetric three-layer schemes of Crank--Nicolson type, a locally linear one and a genuinely nonlinear one, and we show that each of them preserves a discrete analogue of the total mechanical energy of the homogeneous problem with constant coefficients. For the nonlinear scheme we establish uniform apriori bounds on the discrete solution and on its discrete velocity by working directly with the discrete energies, without invoking a nonlinear discrete Grönwall inequality, the constants still grow exponentially in the final time, and we prove local second-order convergence in time, both for the solution and for the central-difference approximation of its first time derivative. The nonlinear system arising at each time level is solved by a fixed-point iteration: given iterates at the two preceding levels that satisfy the apriori bounds, that equation has exactly one solution and the iteration converges to it at a geometric rate once the time step is small enough. Since the apriori bounds are index-local, alternating them with that one-step solver constructs the trajectory stepwise, for time-dependent coefficients as well, on the local interval on which those bounds hold. Numerical experiments, carried out in a setting in which the spatial discretization contributes no error, exhibit the conservation of the discrete invariants, confirm the second order in time and verify the geometric convergence of the fixed-point iteration.

math.NA↗

Graph lattice sums and graph zeta functions for long-range interacting quantum lattice models

Taming the exponential increase of the Hilbert space dimension with system size in the simulation of gapped quantum lattice models is of the highest relevance for understanding and designing exotic quantum materials, where nonlocal interactions are of particular interest. High-order linked-cluster expansions provide access the solution of the eigenvalue problem for the infinite system, yet rely on the computation of high-dimensional oscillatory lattice sums with a graph structure, only approachable with Monte Carlo methods so far. This work resolves this issue, rendering all required graph lattice sums, referred to as graph zeta functions for kernels involving power-laws, computable. The resulting method reduces the evaluation time for state-of-the art series expansions from tenthousands of core-hours to minutes. After factorizing the lattice sum over blocks, each block is evaluated by the cheapest available strategy depending on its treewidth $\mathrm{tw}$. Basic blocks admit analytic forms in terms of generalized zeta functions. Series-parallel blocks with $\mathrm{tw}\le 2$ can be computed at linear cost in the number of graph nodes and in the size of the momentum grid using a semi-analytical algebra based on Epstein zeta functions and rapidly decaying Fourier series. Finally, for $\mathrm{tw}>2$, the method is combined with tensor-network bucket elimination yielding polynomial scaling of numerical work and memory in momentum grid size with exponents only growing with $\mathrm{tw}$ rather than with the number of vertices. Through use of FFT, the full momentum grid is recovered at the cost of a single momentum evaluation. We provide a detailed analysis of the precision and runtime of our method against analytic and numerical benchmarks. We further reproduce published Monte Carlo data for the transverse-field Ising model on different 1D, 2D, and 3D lattices, obtaining full agreement.

math.NA↗

Evaluation of optimisation and Bayesian inference methods for reaction rates in atmospheric chemical mechanisms

Constraining reaction rate coefficients is a central challenge in the development of explicit atmospheric chemical mechanisms, particularly for autoxidation systems where many reaction pathways are only indirectly observed through high-resolution mass spectrometry. In this study, we evaluate rate-coefficient optimisation methods for a toy-case autoxidation mechanism using synthetic data with known ground truth. Two complementary approaches are compared: ODE-constrained neural-network optimisation, which provides efficient point estimates of uncertain rate coefficients, and the Markov Chain Monte Carlo (MCMC) approach, which samples the posterior distribution of rate coefficients and quantifies parameter uncertainty. The methods are tested using direct concentration observations and mass-spectral observations under different noise levels. For unperturbed and low-noise synthetic observations, both methods converged towards the known rate coefficients, with the neural-network optimiser providing faster point estimates. Under high-noise conditions (with the signal-to-noise ratio approximately S / N = 1), however, MCMC was substantially more robust in recovering the rate coefficients. The posterior analysis shows that mass-spectral aggregation broadens credible intervals even at low noise, and that high-noise mass spectra can leave many individual reaction rates weakly identifiable. Posterior predictive validation nevertheless shows how broad parameter uncertainty constrained by MCMC remains consistent with accurate reproduction of the observable mass spectrum. These results demonstrate that point-estimation and Bayesian sampling methods provide complementary information: neural-network optimisation is effective for informative data, whereas MCMC is essential for diagnosing uncertainty, non-uniqueness, and identifiability in noisy or aggregated inverse problems.

stat.ML↗

A Hybridizable Discontinuous Galerkin Method for Wave Propagation in Elastic Beam Networks

This paper studies the numerical solution of elastic wave propagation on networks, modeled by elastodynamic equations posed on each edge, coupled at the nodes through suitable transmission conditions. We propose and analyze a hybridizable discontinuous Galerkin method that exploits the network structure to reduce the global problem at each time step to a linear system whose size depends only on the number of network nodes and not on the polynomial degree of the discretization. Combining it with an energy-conservative implicit time discretization, we derive a priori error estimates of optimal order in space and time. The implicit time discretization avoids the severe CFL restriction caused by the large variation in fiber segment lengths. To efficiently solve the resulting, typically ill-conditioned global system, we introduce a two-level overlapping additive Schwarz preconditioner. Under suitable assumptions on the network, we establish uniform convergence of the resulting preconditioned conjugate gradient method. Numerical experiments confirm the theoretical findings.

math.NA↗

phepy: Visual benchmarks and improvements for out-of-distribution detectors

Applying machine learning to increasingly high-dimensional problems with sparse or biased training data increases the risk that a model is used on inputs outside its training domain. For such out-of-distribution (OOD) inputs, the model can no longer make valid predictions, and its error is potentially unbounded. Since testing OOD detection methods on real-world datasets is complicated, we design a benchmark for OOD detection, which includes three novel and easily-visualisable toy examples. These simple examples provide direct and intuitive insight into whether the detector is able to detect (1) linear and (2) non-linear concepts and (3) identify thin in-distribution (ID) subspaces (needles) within high-dimensional spaces (haystacks). We use our benchmark to evaluate the performance of various methods from the literature. Since tactile examples of OOD inputs may benefit OOD detection, we also review several simple methods to synthesise OOD inputs for supervised training. We introduce two improvements, $t$-poking and OOD sample weighting, to make supervised detectors more precise at the ID-OOD boundary. This is especially important when conflicts between real ID and synthetic OOD sample blur the decision boundary. Finally, we provide recommendations for constructing and applying OOD detectors in machine learning.

cs.LG↗

A numerical method for the fractional Zakharov-Kuznetsov equation

This paper develops a fully discrete Fourier spectral Galerkin (FSG) method for the fractional Zakharov--Kuznetsov (fZK) equation posed on a two-dimensional periodic domain. The equation generalizes the classical ZK model by replacing the Laplacian with a fractional Laplacian of order \(α\in(0,2]\), thereby covering the classical ZK equation \(α=2\), the higher-dimensional Benjamin--Ono--ZK equation \(α=1\), and weaker fractional-dispersion regimes \(0<α<1\). We first propose a semi-discrete FSG scheme in space that preserves the discrete analogues of mass, momentum, and Hamiltonian energy. Using periodic Kato--Ponce product and commutator estimates, we prove local-in-time uniform Sobolev bounds and strong convergence of the semi-discrete approximations to the unique strong solution in \(C([0,\bar T];L^2_{\mathrm{per}}(Ω))\), for the initial condition in \(H^s_{\mathrm{per}}(Ω)\), \(s\geq 2+α\), and, as by product, we show that the existence and uniqueness of fZK equation in \(L^\infty(0,\bar T;H^s_{\mathrm{per}}(Ω))\cap W^{1,\infty}(0,\bar T;L^2_{\mathrm{per}}(Ω))\). We then introduce a modified projection adapted to the fractional transport dispersive operator and prove optimal spatial error estimates of order \(\mathcal O(N^{-r})\) for \(r>2+α\), together with exponential convergence for analytic solutions. An integrating-factor fourth-order four-stage Runge--Kutta time discretization is used to integrate the stiff fractional dispersive part exactly, and a fourth-order temporal error estimate is obtained under a high-regularity nonlinear stability assumption. Numerical experiments illustrate the accuracy, fractional-order dependence, and fully discrete conservation drift of the method.

math.NA↗

A Convergent Hybridizable Discontinuous Galerkin Method for Einstein--Scalar Equations

We propose and analyze a hybridized discontinuous Galerkin (HDG) method for the spherically symmetric Einstein--scalar system in Bondi gauge. After rewriting the model as a local first-order PDE--ODE system by introducing suitable scaled variables, we construct a semidiscrete scheme in which the element unknowns are computed locally and the coupling is carried by traces on the mesh skeleton. In the present radial setting, these traces can be eliminated recursively, so that only the main evolution variable is advanced in time, while the metric variables are recovered from discrete constraint relations. We prove local semidiscrete well-posedness, derive a global \(L^2\)--stability estimate, establish an optimal order \(L^2\) error bound for the main evolution variable for polynomial degree \(k\ge 1\), and obtain reconstruction error estimates for the metric variables and the associated mass functional. Numerical experiments verify the predicted spatial convergence rate and illustrate qualitative features of the Einstein--scalar dynamics, including large-data collapse profiles and smooth-pulse evolution.

math.NA↗

Sufficient conditions for QMC analysis of finite elements for parametric differential equations

Parametric regularity of discretizations of flux vector fields satisfying a balance law is studied under some assumptions on a random parameter that links the flux with an unknown primal variable (often through a constitutive law). In the primary example of the stationary diffusion equation, the parameter corresponds to the inverse of the diffusivity. The random parameter is modeled here as a Gevrey-regular random field. Specific focus is on random fields expressible as functions of countably infinite sequences of independent random variables, which may be uniformly or normally distributed. Quasi-Monte Carlo (QMC) error bounds for some quantity of interest that depends on the flux are then derived using the parametric regularity. It is shown that the QMC method achieves a dimension-independent, faster-than-Monte Carlo convergence rate if the quantity of interest depends continuously on the primal variable, its flux, or its gradient. A series of assumptions are introduced with the goal of encompassing a broad class of discretizations by various finite element methods. The assumptions are verified for the diffusion equation discretized using conforming finite elements, mixed methods, and hybridizable discontinuous Galerkin schemes. Numerical experiments confirm the analytical findings, highlighting the role of accurate flux approximation in QMC methods.

math.NA↗

A Galerkin Finite Element Method for the Fractional Calderón Problem

We study a numerical reconstruction strategy for the potential in the fractional Calderón problem from a single partial exterior measurement. The forward model is the fractional Schrödinger equation in a bounded domain, with prescribed exterior Dirichlet datum and corresponding measurement of the exterior flux in an open observation set. Motivated by single-measurement uniqueness results based on unique continuation \cite{ghosh2020uniqueness}, we propose a decomposition strategy and a Galerkin--Tikhonov method to recover the potential by a stabilized least-squares quotient in a dedicated coefficient space. We prove the existence and uniqueness of the discrete reconstructor and establish conditional convergence under natural consistency and parameter choice assumptions. We further derive {\it a priori} error estimates for the reconstructed state and for the coefficient reconstruction, and combine the latter with logarithmic stability for the continuous inverse problem to obtain a total coefficient error bound. The framework cleanly separates the forward solver from the inverse reconstruction step and is compatible with practical truncation and quadrature schemes for the integral fractional Laplacian. Numerical experiments in one and two space dimensions illustrate stability with respect to noise and demonstrate reconstructions of both smooth and discontinuous potentials.

math.NA↗

Inverse Neural Operator for ODE Parameter Optimization

We propose the Inverse Neural Operator (INO), a two-stage framework for recovering hidden ODE parameters from sparse, partial observations. In Stage 1, a Conditional Fourier Neural Operator (C-FNO) with cross-attention learns a differentiable surrogate that reconstructs full ODE trajectories from arbitrary sparse inputs, suppressing high-frequency artifacts via spectral regularization. In Stage 2, an Amortized Drifting Model (ADM) learns a kernel-weighted velocity field in parameter space, transporting random parameter initializations toward the ground truth without backpropagating through the surrogate, avoiding the Jacobian instabilities that afflict gradient-based inversion in stiff regimes. Experiments on a real-world stiff atmospheric chemistry benchmark (POLLU, 25 parameters) and a synthetic Gene Regulatory Network (GRN, 40 parameters) show that INO outperforms gradient-based and amortized baselines in parameter recovery accuracy while requiring only 0.23s inference time, a 487x speedup over iterative gradient descent.

cs.LG↗

A hybridizable discontinuous Galerkin method for the Ostrovsky equation

This paper develops the hybridizable discontinuous Galerkin (HDG) method for the Ostrovsky equation, a nonlinear dispersive wave equation featuring both third-order dispersion and a nonlocal antiderivative term with Coriolis effect. On a bounded interval, the nonlocal operator $\partial_x^{-1}$ is localized through an auxiliary variable $v$ satisfying $v_x=u$ together with an additional boundary constraint that ensures uniqueness. We employ a mixed first-order formulation to decompose the dispersive operator and to localize the nonlocal term, and we couple the resulting semi-discrete HDG scheme with a $θ$-time stepping method for $θ\in [1/2,1]$. We prove $L^2$-stability for suitable stabilization parameters and derive an {\it a priori} $L^2(Ω)$ error estimate for smooth solutions that explicitly accounts for the nonlinear convective flux. Numerical examples illustrate the convergence properties and demonstrate the scheme's capability to handle smooth and non-smooth solutions, including solitary wave propagation and peaked solitary wave (peakon) propagation in the zero dispersive limit regime.

math.NA↗

Convergence Analysis for the Recovery of the Friction Threshold in a Scalar Tresca Model

We consider a scalar valued elliptic partial differential equation on a sufficiently smooth domain $Ω$, subject to a regularized Tresca friction-type boundary condition on a subset $Γ$ of $\partial Ω$. The friction threshold, a positive function appearing in this boundary condition, is assumed to be unknown and serves as the coefficient to be recovered in our inverse problem. Assuming that (i) the friction threshold lies in a finite dimensional space with known basis functions, (ii) the right hand sides of the partial differential equation are known, and (iii) the solution to the partial differential equation on some small open subset $ω\subset Ω$ is available, we develop an iterative computational method for the recovery of the friction threshold. This algorithm is simple to implement and is based on piecewise linear finite elements. We show that the proposed algorithm converges in second order to a function $a_h$ and, moreover, that $a_h$ converges in second order in the finite element's mesh size $h$ to the true (unknown) friction threshold. We highlight our theoretical results by simulations that confirm our rates numerically.

math.NA↗

Downscaling Neural Network for Coastal Simulations

Learning the fine-scale details of a coastal ocean simulation from a coarse representation is a challenging task. For real-world applications, high-resolution simulations are necessary to advance understanding of many coastal processes, specifically, to predict flooding resulting from tsunamis and storm surges. We propose a Downscaling Neural Network for Coastal Simulation (DNNCS) for spatiotemporal enhancement to learn the high-resolution numerical solution. Given images of coastal simulations produced on low-resolution computational meshes using low polynomial order discontinuous Galerkin discretizations and a coarse temporal resolution, the proposed DNNCS learns to produce high-resolution free surface elevation and velocity visualizations in both time and space. To model the dynamic changes over time and space, we propose grid-aware spatiotemporal attention to project the temporal features to the spatial domain for non-local feature matching. The coordinate information is also utilized via positional encoding. For the final reconstruction, we use the spatiotemporal bilinear operation to interpolate the missing frames and then expand the feature maps to the frequency domain for residual mapping. Besides data-driven losses, the proposed physics-informed loss guarantees gradient consistency and momentum changes, leading to a 24% reduction in root-mean-square error compared to the model trained with only data-driven losses. To train the proposed model, we propose a coastal simulation dataset and use it for model optimization and evaluation. Our method shows superior downscaling quality and fast computation compared to the state-of-the-art methods.

eess.IV↗

A Hybridizable Discontinuous Galerkin Method for the non--local Camassa--Holm--Kadomtsev--Petviashvili equation

This paper develops a hybridizable discontinuous Galerkin method for the two-dimensional Camassa--Holm--Kadomtsev--Petviashvili equation. The method employs Cartesian meshes with tensor-product polynomial spaces, enabling separate treatment of \(x\) and \(y\) derivatives. The non-local operator \(\partial_{x}^{-1}u_{y}\) is localized through an auxiliary variable \(v\) satisfying \(v_x = u_y\), allowing efficient element-by-element computations. We prove energy stability of the semi-discrete scheme and derive \(\mathcal{O}(h^{k+1/2})\) convergence in space. Numerical experiments validate the theoretical results and demonstrate the method's capability to accurately resolve smooth solutions and peaked solitary waves (peakons).

math.NA↗