arXiv Science⌕ Search

SEARCH · arXiv Science

Search arXiv Science

Search indexed arXiv papers on artificial intelligence, large language models, computer vision and robotics. Read source abstracts and follow links to arXiv.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 recordsLinked to original sources

Dynamical Low-Rank Filters for Data Assimilation

We propose dynamical low-rank (DLRA) filters for data-assimilation problems based on stochastic differential equations (SDEs). We first consider a Kalman filter applied to a Euler-Maruyama discretization of the SDE and observation processes, and derive a DLRA Kalman-type filter, named DLRA-JMCO, by minimizing jointly the error on the mean and covariance. We then obtain a time continuous DLRA-JMCO filter as the continuous limit of the time discrete one, and introduce a corresponding particle approximation. We also propose a strategy to enrich the DLRA-JMCO filter with a simple Gaussian process to capture the neglected dynamics in the orthogonal to the DLRA subspace. This correcting term allows the DLRA subspace evolution to be directly influenced by the observation operator. We finally propose a particle filter version of the DLRA-JMCO filter. Numerical experiments assess the performance of the proposed filters.

math.NA↗

Fully discrete stochastic maximal regularity and $H^\infty$-calculus for second-order elliptic operators

This paper establishes the fully discrete stochastic maximal $L^p$-regularity and the accompanying sharp maximal estimate for numerical approximations of parabolic stochastic partial differential equations. We consider the spatial finite element discretization $A_h$ of a general second-order elliptic operator $A=-\nabla \cdot a\nabla +b\cdot \nabla +c$ with Dirichlet boundary conditions on a smooth, bounded, convex domain in $\mathbb{R}^3$, coupled with a broad class of temporal schemes, including rational approximations and the exponential Euler method. To obtain these optimal discrete regularity results, we establish a bounded $H^\infty$-calculus for the discrete spatial operator $A_h$, uniformly in the mesh size $h$. As a direct byproduct, we also establish the discrete-in-space stochastic maximal regularity for the corresponding spatial semi-discretizations. As an application, we establish the pathwise uniform convergence of a fully discrete approximation of the three-dimensional stochastic Allen--Cahn equation with variable diffusion coefficients and multiplicative noise.

math.AP↗

Differentiable Hybrid Modelling for Learning and Optimising Chemical Transport Processes from Experimental Data

Transport models underpin the design and optimisation of chemical processes, yet their constitutive laws are typically hand-picked, their experimental initial conditions are assumed exact, and their computational cost restricts optimisation to a handful of process variables. Here we introduce a differentiable hybrid modelling framework that embeds neural networks within a GPU-accelerated population balance equation solver to discover constitutive laws and assimilate initial conditions directly from experimental crystallisation data. Using thirteen real experiments with multi-dimensional size and shape measurements, we show that treating measured initial conditions as exact yields a physically inconsistent rate law despite improved predictive accuracy, whereas assimilating them recovers a physically consistent, non-linear law and reduces trajectory error sevenfold relative to conventional modelling. End-to-end differentiability further enables gradient-based optimisation of high-dimensional operating profiles, identifying a 300-variable temperature profile that reduces crystal aspect ratio by 25% at constant mass, facilitating superior product attributes. Our framework augments, rather than replaces, mechanistic modelling, offering a general route to learning transport models from data and optimising processes with them.

cs.CE↗

Solving the Offline and Online Min-Max Problem of Non-smooth Submodular-Concave Functions: A Zeroth-Order Approach

We consider max-min and min-max problems with objective functions that are possibly non-smooth, submodular with respect to the minimiser and concave with respect to the maximiser. We investigate the performance of a zeroth-order method applied to this problem. The method is based on the subgradient of the Lovász extension of the objective function with respect to the minimiser and based on Gaussian smoothing to estimate the smoothed function gradient with respect to the maximiser. In expectation sense, we prove the convergence of the algorithm to an $ε$-saddle point in the offline case. Moreover, we show that, in the expectation sense, in the online setting, the algorithm achieves $O(\sqrt{N(1+\bar{P}_N)})$ online duality gap, where $N$ is the number of iterations and $\bar{P}_N$ is the path length of the sequence of optimal decisions. The complexity analysis and hyperparameter selection are presented for all the cases. The theoretical results are illustrated via numerical examples.

math.OC↗

Second-Order Accuracy from Large Local Errors in Interface Problems: A Discrete Green's Function Analysis

Finite difference methods for interface problems often exhibit large local truncation errors near the interface, particularly when discontinuities in coefficients or solution derivatives are present. Nevertheless, many such schemes achieve second-order accuracy, a phenomenon not fully explained by standard pointwise consistency arguments. In this work, we provide a precise explanation of this behavior through the structure of the discrete Green's function associated with the underlying conservative difference operator. An explicit representation of the Green's function reveals a two-plateau structure in its weighted increments. By expressing the numerical error in terms of this Green kernel, we show that the dominant interface truncation errors, although individually of order \(O(1)\), possess a cancellation structure that reduces their effective contribution to the global error. The exact Green's-function analysis leads to a class of conservative interface flux--balance schemes for which the cancellation mechanism yields second-order accuracy in the maximum norm. The weighted harmonic discretization is included as a particular member, and its cancellation property is established directly. For Cartesian grids with a flat interface parallel to a coordinate direction, the same conservative cancellation mechanism persists along grid lines crossing the interface. Numerical experiments in one and two dimensions directly illustrate the predicted cancellation behavior and the resulting second-order accuracy. These results demonstrate that second-order accuracy in interface problems can arise from the interaction between localized truncation errors and the global structure of the discrete operator, rather than from pointwise consistency alone.

math.NA↗

Shallow neural network approximation in mixed Sobolev spaces

We investigate the best $L_2$ approximation of mixed Sobolev spaces by shallow neural networks with $n$ neurons and general activation functions. We first establish an activation-independent Fourier-block principle: if an activation has univariate approximation order $ρ$ in the sense of the Fourier-block property, then the global approximation rate has algebraic order $\min\{α,ρ\}$ for target functions of mixed smoothness $α$, up to explicit logarithmic factors. To verify this property for concrete activations, we introduce a structured univariate approximation condition that implies the Fourier-block property with explicit parameters. For $\mathrm{ReLU}^k$, a matching algebraic lower bound identifies $\min\{α,k+1\}$ as the optimal algebraic approximation exponent in any dimension, up to logarithmic factors in the upper bound. The framework also yields the exponent $\min\{α,k+1\}$ for cardinal B-splines and soft-$\mathrm{ReLU}^k$, and the full mixed-smoothness exponent $α$ for ELU and cosine activations, again up to logarithmic~factors.

math.NA↗

The 2M Multiplication Algorithm for Complex Matrices

Complex matrix multiplication is typically computed using 4 real matrix multiplications (GEMMs) of the same size. The well-known 3M multiplication algorithm reduces this cost to 3 real GEMMs, together with quadratic time pre- and post-processing steps. In this paper, we reduce 3M to 2M for matrices with integer real and imaginary parts, performing complex GEMM with only 2 real GEMMs of the same size, along with quadratic time pre- and post-processing. For floating-point matrices, 2M multiplication combines naturally with the Ozaki-II scheme, yielding a practical, high-performance algorithm for computing a complex floating-point GEMM in roughly twice the time of a real GEMM of the same size. As corollaries, we derive new algorithms for symmetric rank-$k$ updates (SYRK/HERK) that internally use full rectangular GEMMs.

cs.DC↗

Computing matrix functions associated with a Hermitian-definite pencil

We consider the numerical evaluation of the quantity $Af(A^{-1}B)$, where $A$ is Hermitian positive definite, $B$ is Hermitian, and $f$ is a function defined on the spectrum of $A^{-1}B$. This problem is related to the Hermitian-definite matrix pencil $B-λA$. We study the conditioning of the problem, and we introduce several algorithms that combine the Schur decomposition with either the matrix square root or the Cholesky factorization. We study the numerical behavior of these algorithms in floating-point arithmetic, assess their computational costs, and compare their numerical performance. Our analysis suggests that the algorithms based on the Cholesky factorization will be more accurate and efficient than those based on the matrix square root. This is confirmed by our numerical experiments.

math.NA↗

A Sharp Unitarily Invariant Norm Bound for the Off-Diagonal Block Perturbation of a Hermitian Matrix

Let $$ A=\begin{bmatrix} H_1 & E^* \\ E & H_2 \end{bmatrix} \quad\text{and}\quad \widetilde A=\begin{bmatrix} H_1 & 0 \\ 0 & H_2 \end{bmatrix} $$ be partitioned Hermitian matrices, with $\widetilde A$ obtained by dropping the off-diagonal blocks of $A$. Let $η$ be the minimum distance between the spectra of $H_1$ and $H_2$; these spectra may interlace. Define, for $δ,ε\ge0$, $$ ϕ(δ,ε)= \begin{cases} 2ε/(δ+\sqrt{δ^2+4ε^2}), &\quad\mbox{if $(δ,ε)\ne (0,0)$}, 1, &\quad\mbox{if $(δ,ε) = (0,0)$}, \end{cases} $$ and let $\widetilde E=A-\widetilde A$ and $ε_2=\|E\|_2=\|\widetilde E\|_2$, the matrix spectral norm. Li and Li [\emph{Linear Algebra Appl.}, 395:183--190, 2005] established a sharp spectral-norm bound on the changes in the eigenvalues of $A$: $$ \big\|\mathrm{diag}\big(\pmbλ(A)-\pmbλ(\widetilde A)\big)\big\|_2 \le ϕ(η,ε_2)\,\|E\|_2, $$ where $\pmbλ(A)$ is the vector whose components are the eigenvalues of $A$ in descending order and similarly for $\pmbλ(\widetilde A)$. In this paper, this bound is extended to every unitarily invariant norm $\|\cdot\|_\mathrm{ui}$: $$ \big\|\mathrm{diag}\big(\pmbλ(A)-\pmbλ(\widetilde A)\big)\big\|_\mathrm{ui} \le ϕ(η,ε_2)\,\|A-\widetilde A\|_\mathrm{ui}. $$ A $2\times2$ example attains equality for every such norm. An analogous bound for singular values is also established when the off-diagonal blocks of a rectangular matrix are dropped.

math.NA↗

Geometric Ergodicity of Affine Invariant Ensemble Langevin and its Discrete Time Variants

Affine-invariant ensemble samplers are widely used in Bayesian applications. However, their quantitative convergence theory, in particular geometric ergodicity, remains a basic open question. We study the affine invariant ensemble Langevin dynamics, an interacting particle system that uses the empirical covariance of the whole ensemble as a preconditioner. While effective in practice, theoretical understanding of this method is not available beyond plain qualitative convergence in total variation, with a central difficulty being that the empirical covariance can become degenerate. For potentials with bounded Hessian that are strongly convex outside a ball, we prove geometric ergodicity using a novel Lyapunov function that combines the inverse covariance with a coercive exponential energy. We then show that directly applying the Euler--Maruyama scheme can diverge with positive probability, even for a one-dimensional Gaussian target. This motivates a covariance-trace regularization in continuous time. We prove geometric ergodicity of the regularized diffusion and, for sufficiently small step size, of its unadjusted Euler--Maruyama discretization. We also show that the invariant distributions of the discretization converge weakly to the product target distribution as the step size tends to zero. Lastly, we provide an explicit discretization that is both affine-invariant and geometrically ergodic, based on an adaptive step size clamping.

math.ST↗

Annular liquid jets: exact constraint absorption and finite-time loss of global admissibility

An annular liquid jet may enclose a volume of gas and, when surface tension dominates over inertia, close on the symmetry axis at a finite distance. In the one-dimensional membrane model, closure provides an algebraic relation among the state variables at the free end. Earlier domain-adaptive schemes differentiate this relation to obtain an evolution equation for the domain length. We instead absorb the endpoint closure identically in the dependent variable and discretise the reduced system by Chebyshev collocation. Convergence is geometric, published steady data are recovered, and the unsteady calculations are checked by componentwise off-grid residuals, temporal refinement, and an independent upwind finite-difference discretisation. For jets of finite thickness, the convergence length decreases with nozzle thickness when the Froude number, Weber number, nozzle angle, and pressure coefficient are held fixed and the terminal zero remains transversal; this is a parameter-specific model result rather than a universal experimental thickness law. The forced response has a pressure-coefficient maximum near a Strouhal number of 0.093, whereas the convergence-length gain increases monotonically over the globally admissible frequency interval studied. Most importantly, a global positivity check changes the interpretation of the first finite-time event. Under body-force forcing, the mean radius first reaches zero at an interior point while the tracked endpoint remains transversal. The interior contact is quadratic, and the independent finite-difference scheme converges to the same first-contact time. After this event, the tracked endpoint is no longer the first physical closure point, so the single-interval annular-jet representation is no longer globally admissible.

cs.CE↗

A superlinear arclength endgame for corank-one singular polynomial systems

In Numerical Algebraic Geometry (NAG) isolated solutions of polynomial systems are usually computed by tracking a solution curve defined by a homotopy equation. The tracking problem becomes especially challenging close to a singular root (the ``endgame'' regime). Existing approaches include power series endgames, Cauchy endgames, and various methods that regularize the system via dual-space-based {\em deflation}. We introduce a new ``Arclength Endgame'' for corank-1 systems which combines the idea of the classical {\em pseudo-arclength continuation method} with the estimation of the Puiseux series of the curve. We formally prove that it has an R-superlinear rate of convergence in some neighborhood of the root. The method uses only evaluations of the system and its Jacobian. In contrast, previous homotopy techniques with proven superlinear convergence (such as deflation) require computing additional derivatives of the system, or need additional nondegeneracy assumptions involving higher-order derivatives of the system at the singular root. A key step in our approach (as well as in the standard power series endgame) is estimating the ratio $k_1/c$ of the Puiseux series of the curve. We present a new method for that, and discuss its advantages over previous methods.

math.NA↗

Geometry Parameterisation via a Structural Modal Basis for Aerodynamic Shape Optimisation

Aircraft outer mould lines are often heavily constrained early by payload requirements, manufacturability limits, and low-observability considerations. The remaining aerodynamic design space is typically small, highly constrained, and difficult to represent using a concise and physically meaningful set of design variables. A structural modal parameterisation method (MPM) is introduced for such problems. The method constructs a tunable pseudo-structure and solves its eigenvalue problem to obtain a modal basis, from which a selected subset of modes parameterises the geometry. Boundary conditions, stiffness distribution, density, thickness, and added masses are treated as intentional basis-design variables that shape the admissible deformation space prior to optimisation. The resulting design coordinates are independent of any specific flow solver, making the approach broadly applicable. For tightly constrained aerodynamic shape optimisation problems, it provides a practical balance of parameter conciseness, robust constraint awareness, and geometric flexibility.

math.NA↗

The Levin Method for the Summation of One-dimensional and Multidimensional Infinite Series

The Levin method transforms the evaluation of a highly oscillatory integral into the solution of a first-order linear ODE for a slowly varying auxiliary function. This ODE is typically approximated by collocation, after which the integral value is recovered from the auxiliary function at the endpoints. The present work develops a new extension of the Levin method for the summation of one-dimensional and multidimensional infinite oscillatory series. The summation problem is transformed into the solution of a functional equation involving transformed arguments of the unknown function. The resulting approach is particularly attractive in the multidimensional setting, where the range of existing numerical methods is relatively limited.

math.NA↗

Cahn-Hilliard phase-field modeling of tumor growth via locally adaptive isogeometric analysis with THB-splines

Predicting tumor dynamics in biological systems under physiologically relevant conditions using mathematical and computational models remains a challenging problem. Continuum models based on phase-field (diffuse-interface) formulations have proven to be an effective modeling strategy to govern tumor dynamics and interactions of multiple species. Within this framework, the present work investigates a tumor growth model based on the Cahn-Hilliard (CH) equation. The formulation involves a fourth-order differential operator that imposes higher continuity requirement on approximation spaces for a well-defined primal variational formulation. To address this challenge, we use isogeometric analysis (IGA), which inherently satisfies this requirement through spline-based basis functions and eliminates the need for mixed or auxiliary-variable approaches commonly used in standard finite element discretizations. Additionally, a locally adaptive IGA scheme with truncated hierarchical B-splines (THB-splines) is used to reduce computational cost while maintaining accuracy. The model is first evaluated on standard benchmark cases and then applied to an organ-scale, patient-specific geometric model of the breast reconstructed from magnetic resonance imaging (MRI) data. Our results show that the model reproduces known tumor morphologies, ranging from a spheroidal pattern to fingered growth. A series of numerical experiments further shows the diversity of tumor dynamics produced by different model parameter choices. Our findings demonstrate the predictive potential of the CH-based phase-field tumor growth model integrated with a locally adaptive IGA framework.

math.NA↗

Universal Approximation of Nonlinear Operators and Their Derivatives

We show that Universal Approximation (UA) of nonlinear operators and their derivatives via Operator Learning (OL) architectures fails in ${C^k_F}$ (Fréchet) compact-open topologies and in Fréchet--Sobolev norms (i.e. under operator norms). We solve this obstruction by restoring UA in natural weaker topologies: $C^k_B$ (Bastiani) compact-open topologies and (novel) weighted Bastiani--Sobolev spaces for general finite input measures. In full Banach-space generality, these are the first complete generalizations of the corresponding influential classical results in [Hornik, 1991] to infinite-dimensional spaces and OL. Based on our UATs, we formulate Bastiani--Sobolev training in DIOL. These results launch Derivative-Informed Operator Learning (DIOL) (i.e. learning nonlinear operators and their derivatives) on general Banach spaces. We parameterize nonlinear operators via Encoder-Decoder Architectures, classical OL architectures available in general Banach spaces; these include DeepONets, Deep-H-ONets, and PCA-Nets, which our UATs cover. A key mathematical result is that our new weighted Bastiani--Sobolev spaces generalize classical Gaussian (Malliavin) Sobolev spaces on Banach spaces. Open frontiers where DIOL and our UATs find applications are: high-order accuracy in OL; fast constrained optimization in Banach spaces (e.g. optimal control of PDEs, inverse problems) via Learn-Then-Optimize; numerical methods for infinite-dimensional PDEs (e.g. HJB PDEs on Banach spaces from infinite-dimensional optimal control via Optimize-Then-Learn, such as optimal control of PDEs, SPDEs, path-dependent systems, partially observed systems, mean-field control).

cs.LG↗

Overcoming the spatial order barrier for nonlinear SPDEs with additive space-time white noise

We introduce a fully discrete numerical scheme for semilinear SPDEs with additive space-time white noise that overcomes the previous order barrier for the spatial convergence rate. The scheme, which we refer to as the doubly accelerated exponential Euler scheme, achieves a strong convergence rate of $M^{-1+ε}$ in time and $N^{-3/2+ε}$ in space for any $ε>0$, where $M^{-1}$ and $N^{-1}$ are the temporal, respectively the spatial, meshsizes. This substantially improves the standard spatial error bounds of order $N^{-1/2}$ in the literature. Numerical simulations support the findings.

math.NA↗

Smoothed Picard Hamiltonian Monte Carlo

We develop a new low-accuracy sampler, called smoothed Picard Hamiltonian Monte Carlo, which combines Gaussian smoothing, Picard iteration, and higher-order discretization. For a log-concave target $π\propto \exp(-V)$ in dimension $d$ satisfying $0 \prec αI \preceq \nabla^2 V \preceq βI$, with condition number $κ:= β/α$, smoothed Picard HMC returns a sample with $\sqrt α\,W_2(\cdot,π) \le \varepsilon$ using $\widetilde O(κ^2 + κ^{7/6} d^{1/6}/\varepsilon^{1/3})$ gradient queries. We also prove stronger $W_q$ bounds, and then develop an algorithmic framework, the recursive warm start generator, to upgrade these $W_q$ bounds to stronger divergence guarantees. This produces a warm start for the proximal bouncy particle sampler, introduced in a companion work, leading to a high-accuracy log-concave sampler with complexity $\widetilde O((κ^{7/6} d^{1/6} + κ^{1/2} d^{1/4})\mathrm{polylog}(1/\varepsilon))$.

math.ST↗