arXiv ScienceSearch

subject

cs.NA

cs.NA: explore 303 source-linked works published from 2021 to 2026, with original documents and citations.

This collection is a preview while coverage and quality are evaluated.

Search within this collection

Coverage and selection

Includes records with this source-supplied label or an explicit phrase match in their metadata. Matches indicate a mention, not proof that a paper uses a method or tests a material. Source versions are consolidated by DOI.

Sources: arxiv. Collection updated 2026-09-15. Counts describe this index, not the complete source archives.

An Euler scheme for BSDEs via the Wiener chaos decomposition

The Euler scheme is a standard time discretization for BSDEs, but its implementation hinges on approximating conditional expectations and the associated martingale terms at each time step. We propose an implementation based on the Wiener chaos decomposition to approximate these quantities. In contrast to many numerical schemes that rely on a finite-dimensional Markovian representation, our approach accommodates arbitrary $\mathcal{F}_T$-measurable square-integrable terminal conditions. We provide a comprehensive convergence analysis under additional Malliavin regularity assumptions and illustrate the method on several numerical examples, including genuinely non-Markovian problems arising, for instance, in the pricing and hedging of contingent claims under rough-volatility models.

math.NA

A randomized global GMRES method for matrix equations

In this paper, we develop a new Randomized Global Generalized Minimum Residual (RGlGMRES) algorithm for efficiently computing solutions to large scale linear systems with multiple right hand sides. The proposed method builds on a recently developed randomized global Gram Schmidt process, in which sketched Frobenius inner products are employed to approximate the exact Frobenius inner products of high dimensional matrices. We give some new convergence results of the RGlGMRES method for multiple linear systems. In the case where the coefficient matrix A is diagonalizable, we derive new upper bounds for the randomized Frobenius norm of the residual. In this paper, we study how to introduce matrix sketching in this algorithm. It allows us to reduce the dimension of the problem in one of the main steps of the algorithm. We also show how to apply the RGlGMRES method for solving the Lyapunov matrix equation. To validate the effectiveness and practicality of this approach, we conduct several numerical experiments, which demonstrate that our RGlGMRES method is competitive with the global GMRES method for solving large scale multiple linear systems and Lyapunov matrix equation.

math.NA

An intrinsic expansion approach to the Galerkin approximations for the Navier-Stokes equations (with an appendix by Chengzhang Fu)

We study the Galerkin approximation of the three-dimensional Navier-Stokes equations. In particular, we examine the convergence of these solutions in a sequence of finite dimensional spaces as the dimension goes to infinity. For any sequence of steady state or, respectively, time dependent Galerkin solutions that converges to a solution of the Navier-Stokes equations, we obtain a subsequence with an intrinsic asymptotic expansion in appropriate nested function spaces. Consequently, an induced asymptotic expansion is obtained in a more standard spatial Sobolev or, respectively, spatiotemporal Sobolev-Lebesgue space. In the case of steady states, we establish certain relations among leading terms of this expansion.

math.AP

Computing accurate singular values using a mixed-precision one-sided Jacobi algorithm

We present a relative forward error analysis of a mixed-precision preconditioned one-sided Jacobi algorithm, analogous to a two-sided version introduced in [N. J. Higham, F. Tisseur, M. Webb and Z. Zhou, SIAM J. Matrix Anal. Appl. 46 (2025), pp. 2423-2448], which uses low precision to compute the preconditioner, applies it in high precision, and computes the singular value decomposition using the one-sided Jacobi algorithm at working precision. Our analysis yields relative forward error bounds involving the scaled condition number of the preconditioned matrix rather than that of the input matrix, potentially improving accuracy when the former is smaller. We present and analyze two approaches for constructing effective preconditioners. Our numerical experiments demonstrate that our algorithm achieves smaller relative forward errors than the LAPACK routines $\texttt{DGESVJ}$ and $\texttt{DGEJSV}$, as well as the MATLAB function $\texttt{svd}$, particularly for ill-conditioned matrices. Timing tests show that our approach accelerates the convergence of the Jacobi iterations and that the dominant cost arises from a single high-precision matrix-matrix multiplication. With improved software or hardware support for this bottleneck, our algorithm would be faster than the LAPACK one-sided Jacobi algorithm $\texttt{DGESVJ}$ and comparable in speed to the state-of-the-art preconditioned one-sided Jacobi algorithm $\texttt{DGEJSV}$, but much more accurate.

math.NA

Quadratization of Autonomous Partial Differential Equations: Algorithmic Solutions

Quadratization for partial differential equations (PDEs) is a process that formally transforms a PDE with a nonquadratic right-hand side into a quadratic form by introducing auxiliary variables. Even though the existence and uniqueness of the solution of this quadratic form are, as of yet, unknown in the general case, this symbolic transformation has been used in diverse fields to simplify the analysis, simulation, and control of PDE models. This paper presents a rigorous definition of PDE quadratization, a sample case study on the solutions of quadratic representations, and theoretical contributions for the PDE quadratization problem of spatially one-dimensional PDEs, including results on existence and complexity. Its main focus, however, is introducing and analyzing QuPDE, an algorithm based on symbolic computation and discrete optimization that outputs a quadratization for any spatially one-dimensional polynomial or rational PDE. This algorithm is the first computational tool to find quadratizations for PDEs to date. We demonstrate QuPDE's performance by applying it to fourteen nonquadratic PDEs in diverse areas such as fluid mechanics, space physics, chemical engineering, and biological processes. QuPDE delivers a low-order quadratization in each case, uncovering quadratic transformations with fewer auxiliary variables than those previously discovered in the literature for some examples, and finding quadratizations for systems that had not been transformed to quadratic form before.

cs.SC

On a blended Anderson / NGMRES acceleration for the Navier-Stokes Picard iteration: convergence analysis and adaptive depth selection

Anderson acceleration (AA) and nonlinear GMRES (NGMRES) have been successfully applied to improve the efficiency and robustness of many nonlinear solvers, with each being shown to have certain advantages over the other. There are two differences between the AA and NGMRES algorithms: the extrapolations are different, and AA uses fixed point residuals in the optimization problem while NGMRES uses true nonlinear residuals. Motivated by recent AA and NGMRES analyses and numerical testing, we consider a blend of AA and NGMRES that uses the AA extrapolation and the true nonlinear residuals for the optimization problem. To focus our study, we consider the blended method applied to the Picard iteration for the Navier-Stokes equations, but many of the ideas developed herein are extendable to a wide variety of nonlinear systems and solvers. We provide a convergence analysis and proof of acceleration of the blended method, provide a detailed numerical comparison of AA, NMGRES and the blended method for several benchmark tests, and develop an effective adaptive depth strategy.

math.NA

Second-order consistency for learning chaotic dynamics via randomized Jacobian matching

Short-horizon accuracy does not ensure that a learned chaotic system has correct long-time dynamics. Trajectory (zeroth-order) matching constrains vector-field values, and Jacobian (first-order) matching constrains local tangent dynamics, but neither determines how the Jacobian varies away from supervised states, so a model can be locally accurate while drifting toward spurious attractors and distorting long-time statistics. We show that second-order supervision mitigates these failures. Because forming full Hessian tensors is computationally prohibitive in high dimensions, we propose model-constrained randomized Jacobian matching, which compares the Jacobians of the true and learned vector fields at randomly perturbed inputs. A Taylor expansion shows that the expected randomized Jacobian loss decomposes into the Jacobian mismatch plus a Hessian mismatch scaled by the noise variance, implicitly enforcing second-order consistency at $O(d^2)$ memory cost without forming the $O(d^3)$ Hessian tensor. In Lorenz 63 with minimal temporal supervision, second-order supervision reduces invariant-measure error and Lyapunov-spectrum MSE, and recovers the constant Hessian norm of the true bilinear field. Across five training seeds, explicit Hessian matching produces catastrophic Lyapunov outliers for four of five seeds, whereas randomized Jacobian matching produces none among 5,000 on-attractor rollouts, and it attains the largest threshold in a directional capture scan. In coupled Lorenz 96, first-order methods enter spurious high-amplitude regimes as forcing increases, while second-order methods retain accurate marginals. Randomized Jacobian matching costs about the same as explicit Hessian matching on Lorenz 63 and 40% less on Lorenz 96, with no reference Hessian evaluations during training.

math.NA

Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats

Numeric format proliferation in machine learning hardware -- FP8 (E4M3 and E5M2), BF16, MXFP4, microscaling block formats, and dozens of research variants -- has outpaced the availability of vendor-neutral, bit-exact reference material. Engineers porting models across accelerators encounter silent divergences that are difficult to diagnose without a shared ruler. This paper describes a catalog of 109 numeric formats spanning 12 clusters (83 at v2; the count is a catalog invariant, not a fixed number), a suite of six bit-exact conformance packs covering GF16, MXFP4 element, BF16, FP8 E4M3, FP8 E5M2, and E8M0 block scale, and an IEEE P3109 v3.2.0 cross-walk that maps each pack to its corresponding standards-track configured format. Each pack is a self-contained JSON document with a SHA-256 fingerprint, a shared row schema, and an anchor vector that encodes 3.0 -- the identity phi^2 + 1/phi^2 = 3 -- as a cross-pack sanity check. Packs are cross-validated against ml_dtypes 0.5.4 (Google/JAX); any divergence is documented explicitly and interpreted as a spec-permitted interpretation gap rather than hidden. The work is framed as registry filling: it does not propose new formats, make model-accuracy claims, or assert superiority over any vendor's implementation. All artifacts are publicly available at https://github.com/gHashTag/t27 under an open license.

cs.AR

A multilevel stochastic-gradient neural solver for boundary integral equations

We propose a multilevel stochastic-gradient neural solver (MLSG) for second-kind boundary integral equations. MLSG represents the unknown boundary density using a neural network optimized by stochastic residual minimization over a hierarchy of successively refined Nyström discretizations. Upon transitioning from one level to the next, the network parameters obtained on the previous level initialize training on the current one. This coarse-to-fine strategy retains a continuous, grid-independent density representation and is designed to reduce the total computational effort required to reach a prescribed residual tolerance at the target resolution. The algorithm avoids grid-transfer operators and hierarchical fast-summation machinery, relying instead on batched kernel evaluations and standard network forward and backward passes that map efficiently onto modern GPU architectures. For uniformly stable second-kind discretizations, so strongly nonuniform contraction rates originate in the empirical neural tangent kernel (NTK) rather than in the discretized operator. Within each level, parameter updates can reshape the NTK, while refinement re-samples the tangent kernel on a richer discrete space and reveals directions that were not adequately resolved on coarser levels. A cross-level estimate bounds the warm-start loss in terms of the preceding training tolerance and quadrature error, motivating a tolerance schedule that balances optimization and discretization errors. Experiments on Laplace/Poisson and Helmholtz problems in two and three dimensions, together with an exterior Robin problem on a hypersurface in $\R^4$, demonstrate the method under both parametric and signed-distance surface representations at up to million-scale discretizations.

math.NA

NGMRES convergence analysis and proof of acceleration for contractive and noncontractive iterations

This paper gives the first convergence analysis and proof of acceleration for nonlinear GMRES (NGMRES) applied to contractive and noncontractive fixed point iterations (FPIs) for solving general nonlinear systems. Our main results are that in both the contractive and noncontractive cases, the ratio gain of the optimization problem is the mechanism responsible for accelerating (or enabling) convergence. Our analysis also reveals a second important quantity related to the optimization problem, which directly predicts the linear convergence rate at each iteration and proves it is at most 1; hence only higher order terms are responsible for NGMRES non-convergence. Numerical results for several challenging nonlinear test problems are given that illustrate the theory, show how the acceleration improves convergence, show that the quantity predicting the linear convergence rate is remarkably accurate and moreover can be useful for adaptively choosing NGMRES depth, show how restarts can improve convergence in noncontractive iterations, show how NGMRES is naturally suited for finding distinct solutions of a multi-solution PDE, and that NGMRES can perform better than Anderson acceleration when applied to superlinear FPIs.

math.NA

High-order $L^2$-Galerkin schemes for the decoupled potential integral equations

We prove Sobolev space well-posedness of the decoupled potential integral equations. Using basic pseudo-differential techniques, discrete stability is obtained for the standard $L^2$-pairing, and we deduce spectral convergence for a high-order scheme employing discontinuous basis functions, or with additional element-wise tangential continuity imposed in the vectorial part of the system. The scheme is shown to be much better conditioned than a mature commercial EFIE/CFIE solver. In many cases appearing almost independent of wavenumber, mesh density, and the order.

math.NA

An Interface Green's Function Framework for Complete Discrete $W^{1,\infty}$ Analysis of Discontinuous Galerkin Methods

Pointwise error analysis of discontinuous Galerkin (DG) methods for the Poisson equation has received considerable attention during the past two decades. However, on convex polyhedral domains, existing analyses can only establish optimal error estimates in the broken $W^{1,\infty}$ seminorm for several DG methods. Since the broken $W^{1,\infty}$ seminorm does not control discontinuities across mesh interfaces, a complete discrete $W^{1,\infty}$ theory for discontinuous approximations on convex polyhedral domains has remained unavailable. In this paper, we develop an interface Green's function framework for the complete discrete $W^{1,\infty}$ analysis of DG methods on convex polyhedral domains. The proposed framework introduces new interface Green's functions that represent jumps of discontinuous approximations across mesh interfaces. Its central analytical ingredient is a new local energy estimate for these Green's functions, obtained by exploiting a cancellation between neighboring discrete delta functions. This estimate differs fundamentally from existing Green's function estimates and enables us to derive maximum-norm estimate for interface jumps without introducing additional logarithmic factors.

math.NA

A Neural-network-based multiscale Hybridizable Discontinuous Galerkin method for solving PDEs in porous media

We develop a neural-network-accelerated multiscale hybridizable discontinuous Galerkin method for elliptic problems with heterogeneous coefficients. The method preserves the standard MsHDG local-to-global structure: fine-scale HDG problems on coarse blocks define discrete Dirichlet-to-Neumann operators, which are assembled through the standard MsHDG global skeleton equations. To reduce the cost of constructing these local operators, we train a neural network on coefficient fields defined on a reference block and use the predicted operators in place of repeated fine-scale local solves. The numerical experiments assess both the accuracy and online efficiency of the resulting NN-MsHDG method. For two-dimensional binary permeability fields with moderate contrast, the neural method reproduces the standard MsHDG solution with relative modeling errors of a few percent while reducing the total online computational cost by factors of approximately 5 to 16, depending on the coarse trace dimension. In the high-contrast regime, the chosen polynomial coarse trace spaces already yield substantial discretization errors in the standard MsHDG method, indicating the need for more effective coarse spaces, such as coefficient-adapted spectral trace spaces. In addition, the learned local operators introduce modeling errors that become severe as the trace space is enriched. These results demonstrate the potential of neural surrogates for accelerating multiscale HDG computations while also highlighting the need for improved operator representations and a better understanding of error amplification in high-contrast problems.

math.NA

Closure complexity of longest-edge bisection for triangular meshes

On triangular meshes, we analyze local mesh refinement based on longest-edge bisection equipped with the serial longest-edge propagation-path closure. Ties are resolved by terminal priority: if the incoming shared edge is a longest edge of the neighboring triangle, the pair is declared terminal and that edge is bisected. For every adaptive mesh sequence $\mathcal{T}_0, \mathcal{T}_1, \ldots, \mathcal{T}_L$ with a sequence of marked sets $\mathcal{M}_0, \mathcal{M}_1, \ldots, \mathcal{M}_{L-1}$, we prove the cumulative closure estimate $$\#\mathcal{T}_L-\#\mathcal{T}_0 \lesssim\sum_{\ell=0}^{L-1}\#\mathcal{M}_\ell.$$ The proof derives single-mark locality from the uniform multiplicative gap between possible descendant diameters implied by finite similarity classes, and converts this locality into the cumulative estimate through a Binev--Dahmen--DeVore-type charging argument.

math.NA

A class of high-order discontinuous-Galerkin methods satisfying infinitely many entropy conditions with provable error estimates and strong convergence for general nonlinear conservation laws

We propose a novel framework for deriving semi-discrete discontinuous-Galerkin (DG) methods using operator semigroups for scalar conservation laws, then apply it to construct a class of high-order OFDG-type schemes [13] satisfying infinitely many local entropy inequalities with general E-fluxes on non-uniform meshes. Such schemes are further generalized to systems of conservation laws in any number of space dimensions by using entropy stable numerical fluxes in the sense of [1]. Finally, we prove optimal error estimates for smooth solutions to nonlinear scalar conservation laws, and prove strong convergence for discontinuous solutions to strictly convex conservation laws via compensated compactness.

math.NA

Numerical experiments on the Hardy conjecture for the Gauss circle problem

The classical unsolved Gauss circle problem concerns estimating the error between the number of lattice points inside a circle and the area of the circle as its radius tends to infinity. About a century ago, Hardy proposed a conjecture concerning this problem. In this paper, we attempt to provide numerical evidence in support of the Hardy conjecture through large-scale numerical computations.

math.NT

Energy-Consistent Splitting and Decomposition Approaches for Coupled port-Hamiltonian ODEs

Operator splitting provides an attractive approach for the numerical integration of (coupled) port-Hamiltonian systems, as it allows the underlying system structure to be exploited at the level of the individual subproblems. However, the choice of the decomposition is not unique and may strongly affect both the computational efficiency and the preservation of the energy behavior of the original system. In this work, we investigate this interplay systematically and introduce energy consistency as a criterion for assessing splitting methods for port-Hamiltonian ordinary differential equations. We derive sufficient conditions under which a splitting based on a given decomposition inherits the energy behavior of the continuous system and use these conditions to analyze several decomposition strategies for coupled port-Hamiltonian systems. In particular, we compare decompositions that preserve the structure with approaches that exploit lower-dimensional subsystem dynamics or separated time scales. The analysis is complemented by numerical experiments using Strang splitting and its multiple-time-stepping extension. A scalable electro-thermal benchmark with fast electrical and slow thermal dynamics is employed to assess accuracy, energy behavior, and computational efficiency. The results demonstrate that preserving the port-Hamiltonian structure of the subflows is essential for energy-consistent splitting, whereas decompositions that exploit subsystem structure or time-scale separation can provide substantial computational advantages. In particular, the time-scale decomposition yields significant efficiency gains for systems with pronounced multirate characteristics, while structure-destroying decompositions may lead to undesirable energy behavior.

math.NA

Fast Gauss Sums via Flash Attention

Gaussian kernel sums are the computational core of maximum mean discrepancies (MMDs), kernel gradient flows, Stein variational gradient descent (SVGD), and many other kernel methods. At the same time, softmax attention has received an extraordinary amount of hardware-aware code engineering, culminating in flash attention. We show that Gauss kernel sums with arbitrary, signed weights can be evaluated via flash attention: two small input augmentations turn the normalized softmax reduction into the unnormalized Gauss sum, without writing a single line of custom GPU code. For feature dimension D>8 in fp16, this approach beats compiled PyTorch code as well as PyKeOps kernels (often significantly) in speed, memory-overhead and accuracy. Indeed, its memory scaling remains linear.

cs.LG
Compare source metadata on this page
WorkPublishedSource identifierSource
An Euler scheme for BSDEs via the Wiener chaos decomposition2026-09-042512.16418arxiv
A randomized global GMRES method for matrix equations2026-09-042602.14786arxiv
An intrinsic expansion approach to the Galerkin approximations for the Navier-Stokes equations (with an appendix by Chengzhang Fu)2026-09-042602.16064arxiv
Computing accurate singular values using a mixed-precision one-sided Jacobi algorithm2026-09-042602.18134arxiv
Quadratization of Autonomous Partial Differential Equations: Algorithmic Solutions2026-09-042602.22371arxiv
On a blended Anderson / NGMRES acceleration for the Navier-Stokes Picard iteration: convergence analysis and adaptive depth selection2026-09-042605.17664arxiv
Second-order consistency for learning chaotic dynamics via randomized Jacobian matching2026-09-042606.01596arxiv
Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats2026-09-042606.09686arxiv
A multilevel stochastic-gradient neural solver for boundary integral equations2026-09-042607.00560arxiv
NGMRES convergence analysis and proof of acceleration for contractive and noncontractive iterations2026-09-042607.14268arxiv
High-order $L^2$-Galerkin schemes for the decoupled potential integral equations2026-09-042608.10799arxiv
An Interface Green's Function Framework for Complete Discrete $W^{1,\infty}$ Analysis of Discontinuous Galerkin Methods2026-09-042608.11559arxiv
A Neural-network-based multiscale Hybridizable Discontinuous Galerkin method for solving PDEs in porous media2026-09-042608.25850arxiv
Closure complexity of longest-edge bisection for triangular meshes2026-09-042609.04003arxiv
A class of high-order discontinuous-Galerkin methods satisfying infinitely many entropy conditions with provable error estimates and strong convergence for general nonlinear conservation laws2026-09-042609.04687arxiv
Numerical experiments on the Hardy conjecture for the Gauss circle problem2026-09-042609.04725arxiv
Energy-Consistent Splitting and Decomposition Approaches for Coupled port-Hamiltonian ODEs2026-09-042609.04884arxiv
Fast Gauss Sums via Flash Attention2026-09-042609.04910arxiv

These are bibliographic comparisons, not experimental rankings. Follow the original document for methods and conditions.