arXiv Science⌕ Search

SEARCH · arXiv Science

Results for “math.NA”

Search indexed arXiv papers on artificial intelligence, large language models, computer vision and robotics. Read source abstracts and follow links to arXiv.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2Linked to original sources

Wind Field Reconstruction with Adaptive Random Fourier Features

We investigate the use of spatial interpolation methods for reconstructing the horizontal near-surface wind field given a sparse set of measurements. In particular, random Fourier features is compared to a set of benchmark methods including Kriging and Inverse distance weighting. Random Fourier features is a linear model $β(\pmb x) = \sum_{k=1}^K β_k e^{iω_k \pmb x}$ approximating the velocity field, with frequencies $ω_k$ randomly sampled and amplitudes $β_k$ trained to minimize a loss function. We include a physically motivated divergence penalty term $|\nabla \cdot β(\pmb x)|^2$, as well as a penalty on the Sobolev norm. We derive a bound on the generalization error and derive a sampling density that minimizes the bound. Following (arXiv:2007.10683 [math.NA]), we devise an adaptive Metropolis-Hastings algorithm for sampling the frequencies of the optimal distribution. In our experiments, our random Fourier features model outperforms the benchmark models.

math.NA↗

A new Directional Algebraic Fast Multipole Method based iterative solver for the Lippmann-Schwinger equation accelerated with HODLR preconditioner

We present a fast iterative solver for scattering problems in 2D, where a penetrable object with compact support is considered. By representing the scattered field as a volume potential in terms of the Green's function, we arrive at the Lippmann-Schwinger equation in integral form, which is then discretized using an appropriate quadrature technique. The discretized linear system is then solved using an iterative solver accelerated by Directional Algebraic Fast Multipole Method (DAFMM). The DAFMM presented here relies on the directional admissibility condition of the 2D Helmholtz kernel. And the construction of low-rank factorizations of the appropriate low-rank matrix sub-blocks is based on our new Nested Cross Approximation (NCA)~\cite{ arXiv:2203.14832 [math.NA]}. The advantage of our new NCA is that the search space of so-called far-field pivots is smaller than that of the existing NCAs. Another significant contribution of this work is the use of HODLR based direct solver as a preconditioner to further accelerate the iterative solver. In one of our numerical experiments, the iterative solver does not converge without a preconditioner. We show that the HODLR preconditioner is capable of solving problems that the iterative solver can not. Another noteworthy contribution of this article is that we perform a comparative study of the HODLR based fast direct solver, DAFMM based fast iterative solver, and HODLR preconditioned DAFMM based fast iterative solver for the discretized Lippmann-Schwinger problem. To the best of our knowledge, this work is one of the first to provide a systematic study and comparison of these different solvers for various problem sizes and contrast functions. In the spirit of reproducible computational science, the implementation of the algorithms developed in this article is made available at \url{https://github.com/vaishna77/Lippmann_Schwinger_Solver}.

math.NA↗

A Discrepancy Bound for a Deterministic Acceptance-Rejection Sampler

We consider an acceptance-rejection sampler based on a deterministic driver sequence. The deterministic sequence is chosen such that the discrepancy between the empirical target distribution and the target distribution is small. We use quasi-Monte Carlo (QMC) point sets for this purpose. The empirical evidence shows convergence rates beyond the crude Monte Carlo rate of $N^{-1/2}$. We prove that the discrepancy of samples generated by the QMC acceptance-rejection sampler is bounded from above by $N^{-1/s}$. A lower bound shows that for any given driver sequence, there always exists a target density such that the star discrepancy is at most $N^{-2/(s+1)}$. For a general density, whose domain is the real state space $\mathbb{R}^{s-1}$, the inverse Rosenblatt transformation can be used to convert samples from the $(s-1)-$dimensional cube to $\mathbb{R}^{s-1}$. We show that this transformation is measure preserving. This way, under certain conditions, we obtain the same convergence rate for a general target density defined in $\mathbb{R}^{s-1}$. Moreover, we also consider a deterministic reduced acceptance-rejection algorithm recently introduced by Barekat and Caflisch [F. Barekat and R.Caflisch. Simulation with Fluctuation and Singular Rates. ArXiv:1310.4555[math.NA], 2013.]

math.ST↗

From Euler to Today: Universal Mathematical Fallibility A Large-Scale Computational Analysis of Errors in ArXiv Papers

We present the results of a large-scale computational analysis of mathematical papers from the ArXiv repository, demonstrating a comprehensive system that not only detects mathematical errors but provides complete referee reports with journal tier recommendations. Our automated analysis system processed over 37,000 papers across multiple mathematical categories, revealing significant error rates and quality distributions. Remarkably, the system identified errors in papers spanning three centuries of mathematics, including works by Leonhard Euler (1707-1783) and Peter Gustav Lejeune Dirichlet (1805-1859), as well as contemporary Fields medalists. In Numerical Analysis (math.NA), we observed an error rate of 9.6\% (2,271 errors in 23,761 papers), while Geometric Topology (math.GT) showed 6.5\% (862 errors in 13,209 papers). Strikingly, Category Theory (math.CT) showed 0\% errors in 93 papers analyzed, with evidence suggesting these results are ``easier'' for automated analysis. Beyond error detection, the system evaluated papers for journal suitability, recommending 0.4\% for top generalist journals, 15.5\% for top field-specific journals, and categorizing the remainder across specialist venues. These findings demonstrate both the universality of mathematical error across all eras and the feasibility of automated comprehensive mathematical peer review at scale. This work demonstrates that the methodology, while applied here to mathematics, is discipline-agnostic and could be readily extended to physics, computer science, and other fields represented in the ArXiv repository.

math.HO↗

Structure and structure-preserving algorithms for plasma physics

Hamiltonian and action principle (HAP) formulations of plasma physics are reviewed for the purpose of explaining structure preserving numerical algorithms. Geometric structures associated with and emergent from HAP formulations are discussed. These include conservative integration, which exactly conserves invariants, symplectic integration, which exactly preserves the Hamiltonian geometric structure, and other Hamiltonian integration techniques. Basic ideas of variational integration and Poisson integration, which can preserve noncanonical Hamiltonian structure, are discussed. Metriplectic integration, which preserves the structure of conservative systems with both Hamiltonian and dissipative parts, is proposed. Two kinds of simulated annealing, a relaxation technique for obtaining equilibrium states, are reviewed: one that uses metriplectic dynamics, which maximizes an entropy at fixed energy, the other that uses double bracket dynamics, which preserves Casimir invariants. Throughout, applications to plasma systems are emphasized. The paper culminates with a discussion of GEMPIC [Kraus et al., arXiv:1609.03053v1 [math.NA] (2016)], a particle in cell code that incorporates Hamiltonian and geometrical structure preserving properties.

physics.plasm-ph↗

Fast and accurate clothoid fitting

An effective solution to the problem of Hermite $G^1$ interpolation with a clothoid curve is provided. At the beginning the problem is naturally formulated as a system of nonlinear equations with multiple solutions that is generally difficult to solve numerically. All the solutions of this nonlinear system are reduced to the computation of the zeros of a single nonlinear equation. A simple strategy, together with the use of a good and simple guess function, permits to solve the single nonlinear equation with a few iterations of the Newton--Raphson method. The computation of the clothoid curve requires the computation of Fresnel and Fresnel related integrals. Such integrals need asymptotic expansions near critical values to avoid loss of precision. This is necessary when, for example, the solution of interpolation problem is close to a straight line or an arc of circle. Moreover, some special recurrences are deduced for the efficient computation of asymptotic expansion. The reduction of the problem to a single nonlinear function in one variable and the use of asymptotic expansions make the solution algorithm fast and robust.

math.NA↗

Structure Preserving Model Order Reduction of Shallow Water Equations

In this paper, we present two different approaches for constructing reduced-order models (ROMs) for the two-dimensional shallow water equation (SWE). The first one is based on the noncanonical Hamiltonian/Poisson form of the SWE. After integration in time by the fully implicit average vector field method, ROMs are constructed with proper orthogonal decomposition/discrete empirical interpolation method (POD/DEIM) that preserves the Hamiltonian structure. In the second approach, the SWE as a partial differential equation with quadratic nonlinearity is integrated in time by the linearly implicit Kahan's method and ROMs are constructed with the tensorial POD that preserves the linear-quadratic structure of the SWE. We show that in both approaches, the invariants of the SWE such as the energy, enstrophy, mass, and circulation are preserved over a long period of time, leading to stable solutions. We conclude by demonstrating the accuracy and the computational efficiency of the reduced solutions by a numerical test problem.

math.NA↗

Substructured formulations of nonlinear structure problems - influence of the interface condition

We investigate the use of non-overlapping domain decomposition (DD) methods for nonlinear structure problems. The classic techniques would combine a global Newton solver with a linear DD solver for the tangent systems. We propose a framework where we can swap Newton and DD, so that we solve independent nonlinear problems for each substructure and linear condensed interface problems. The objective is to decrease the number of communications between subdomains and to improve parallelism. Depending on the interface condition, we derive several formulations which are not equivalent, contrarily to the linear case. Primal, dual and mixed variants are described and assessed on a simple plasticity problem.

math.NA↗

Trefftz discontinuous Galerkin methods on unstructured meshes for the wave equation

We describe and analyse a space-time Trefftz discontinuous Galerkin method for the wave equation. The method is defined for unstructured meshes whose internal faces need not be aligned to the space-time axes. We show that the scheme is well-posed and dissipative, and we prove a priori error bounds for general Trefftz discrete spaces. A concrete discretisation can be obtained using piecewise polynomials that satisfy the wave equation elementwise.

math.NA↗

Approximation Theory of Tree Tensor Networks: Tensorized Univariate Functions -- Part I

We study the approximation of functions by tensor networks (TNs). We show that Lebesgue $L^p$-spaces in one dimension can be identified with tensor product spaces of arbitrary order through tensorization. We use this tensor product structure to define subsets of $L^p$ of rank-structured functions of finite representation complexity. These subsets are then used to define different approximation classes of tensor networks, associated with different measures of complexity. These approximation classes are shown to be quasi-normed linear spaces. We study some elementary properties and relationships of said spaces. In part II of this work, we will show that classical smoothness (Besov) spaces are continuously embedded into these approximation classes. We will also show that functions in these approximation classes do not possess any Besov smoothness, unless one restricts the depth of the tensor networks. The results of this work are both an analysis of the approximation spaces of TNs and a study of the expressivity of a particular type of neural networks (NN) -- namely feed-forward sum-product networks with sparse architecture. The input variables of this network result from the tensorization step, interpreted as a particular featuring step which can also be implemented with a neural network with a specific architecture. We point out interesting parallels to recent results on the expressivity of rectified linear unit (ReLU) networks -- currently one of the most popular type of NNs.

math.FA↗

A posteriori estimates for conforming Kirchhoff plate elements

We derive a residual a posteriori estimator for the Kirchhoff plate bending problem. We consider the problem with a combination of clamped, simply supported and free boundary conditions subject to both distributed and concentrated (point and line) loads. Extensive numerical computations are presented to verify the functionality of the estimators.

math.NA↗

Towards stability of radial basis function based cubature formulas

Cubature formulas (CFs) based on radial basis functions (RBFs) have become an important tool for multivariate numerical integration of scattered data. Although numerous works have been published on such RBF-CFs, their stability theory can still be considered as underdeveloped. Here, we strive to pave the way towards a more mature stability theory for RBF-CFs. In particular, we prove stability for RBF-CFs based on compactly supported RBFs under certain conditions on the shape parameter and the data points. Moreover, it is shown that asymptotic stability of many RBF-CFs is independent of polynomial terms, which are often included in RBF approximations. While our findings provide some novel conditions for stability of RBF-CFs, the present work also demonstrates that there are still many gaps to fill in future investigations.

math.NA↗

Stability of Overintegration Methods for Nodal Discontinuous Galerkin Spectral Element Methods

We perform stability analyses for discontinuous Galerkin spectral element approximations of linear variable coefficient hyperbolic systems in three dimensional domains with curved elements. Although high order, the precision of the quadratures used are typically too low with respect to polynomial order associated with their arguments, which introduces aliasing errors that can destabilize an approximation, especially when the solution is underresolved. We show that using a larger number of points in the volume quadrature, often called "overintegration", can eliminate the aliasing term associated with the volume, but introduces new aliasing errors at the surfaces that can destabilize the solution. Increased quadrature precision on both the volume and surface terms, on the other hand, leads to a stable approximation. The results support the findings of Mengaldo et al. [Dealiasing techniques for high-order spectral element methods on regular and irregular grids. Journal of Computational Physics, 299:56 -- 81, 2015] who found that fully consistent integration was more robust for the solution of compressible flows than the volume only version.

math.NA↗

Construction of $G^2$ planar Hermite interpolants with prescribed arc lengths

In this paper we address the problem of constructing $G^2$ planar Pythagorean--hodograph (PH) spline curves, that interpolate points, tangent directions and curvatures, and have prescribed arc-length. The interpolation scheme is completely local. Each spline segment is defined as a PH biarc curve of degree $7$, which results in having a closed form solution of the $G^2$ interpolation equations depending on four free parameters. By fixing two of them to zero, it is proven that the length constraint can be satisfied for any data and any chosen ratio between the two boundary tangents. Length interpolation equation reduces to one algebraic equation with four solutions in general. To select the best one, the value of the bending energy is observed. Several numerical examples are provided to illustrate the obtained theoretical results and to numerically confirm that the approximation order is $5$.

math.NA↗

Robust exponential convergence of hp-FEM in balanced norms for singularly perturbed reaction-diffusion problems: corner domains

The hp-version of the finite element method is applied to singularly perturbed reaction-diffusion type equations on polygonal domains. The solution exhibits boundary layers as well as corner layers. On a class of meshes that are suitable refined near the boundary and the corners, robust exponential convergence (in the polynomial degree) is shown in both a balanced norm and the maximum norm.

math.NA↗

Real-time optimal control of high-dimensional parametrized systems by deep learning-based reduced order models

Steering a system towards a desired target in a very short amount of time is challenging from a computational standpoint. Indeed, the intrinsically iterative nature of optimal control problems requires multiple simulations of the physical system to be controlled. Moreover, the control action needs to be updated whenever the underlying scenario undergoes variations. Full-order models based on, e.g., the Finite Element Method, do not meet these requirements due to the computational burden they usually entail. On the other hand, conventional reduced order modeling techniques such as the Reduced Basis method, are intrusive, rely on a linear superimposition of modes, and lack of efficiency when addressing nonlinear time-dependent dynamics. In this work, we propose a non-intrusive Deep Learning-based Reduced Order Modeling (DL-ROM) technique for the rapid control of systems described in terms of parametrized PDEs in multiple scenarios. In particular, optimal full-order snapshots are generated and properly reduced by either Proper Orthogonal Decomposition or deep autoencoders (or a combination thereof) while feedforward neural networks are exploited to learn the map from scenario parameters to reduced optimal solutions. Nonlinear dimensionality reduction therefore allows us to consider state variables and control actions that are both low-dimensional and distributed. After (i) data generation, (ii) dimensionality reduction, and (iii) neural networks training in the offline phase, optimal control strategies can be rapidly retrieved in an online phase for any scenario of interest. The computational speedup and the high accuracy obtained with the proposed approach are assessed on different PDE-constrained optimization problems, ranging from the minimization of energy dissipation in incompressible flows modelled through Navier-Stokes equations to the thermal active cooling in heat transfer.

math.OC↗

Poloidal-toroidal decomposition in a finite cylinder. I. Influence matrices for the magnetohydrodynamic equations

The Navier-Stokes equations and magnetohydrodynamics equations are written in terms of poloidal and toroidal potentials in a finite cylinder. This formulation insures that the velocity and magnetic fields are divergence-free by construction, but leads to systems of partial differential equations of higher order, whose boundary conditions are coupled. The influence matrix technique is used to transform these systems into decoupled parabolic and elliptic problems. The magnetic field in the induction equation is matched to that in an exterior vacuum by means of the Dirichlet-to-Neumann mapping, thus eliminating the need to discretize the exterior. The influence matrix is scaled in order to attain an acceptable condition number.

math.NA↗

Sequential Refinement Solver using Space-Time Domain Decomposition for Non-linear Multiphase Flow Problems

Convergence failure and slow convergence rate are among the biggest challenges with solving the system of non-linear equations numerically. While using strictly small time steps sizes and unconditionally stable fully implicit scheme mitigate the problem, the computational load becomes enormous. We introduce a sequential local refinement scheme in space-time domain that improves convergence rate and prevents convergence failure while not restricting to small time step, thus boosting computational efficiency. We rely on the non-linear two-phase flow model. The algorithm starts by solving the coarsest mesh. Then regions with certain features such as saturation front is refined to the finest resolution sequentially. Such process prevents convergence failure. After each refinement, the solution from the previous mesh is used to estimate initial guess of the current mesh for faster convergence. Numerical results are presented to confirm accuracy of our algorithm as compared to the traditional fine time step approach. We also observe 5 times speedup in the runtime by using our algorithm.

math.NA↗