arXiv subjects

Victorita Dolean

Publications and source records attributed to Victorita Dolean.

At least 19 recordsLinked to original sources

arXiv2026

Advanced Linear Algebra with Applications - Part I (Numerical linear algebra for PDEs, machine learning, and data assimilation)

These lecture notes form the first part of a master's-level course on advanced numerical linear algebra. Their aim is not only to present the classical algorithms, but to show why the subject has become considerably more central than it was a generation ago. Numerical linear algebra grew up alongside the numerical solution of partial differential equations, and for a long time that is where its large sparse systems came from. Ranking the nodes of a network, assimilating observations into a weather forecast, and fitting a model to a large noisy data set now lead to problems of the same kind: too large to factorise, structured, and accessible only through matrix-vector products. Strikingly few ideas are needed for all of them. Each chapter therefore develops a standard topic and then puts it to work outside its original setting. We treat norms, factorisations, conditioning and floating-point arithmetic; sparse matrices arising from finite differences, from graphs and from machine learning; stationary iterations and the smoothing property; the conjugate gradient and Lanczos methods, with spectral clustering and regularisation by early stopping; Arnoldi and GMRES, with PageRank and large least squares; and finally preconditioning, Schwarz domain decomposition and multigrid. We assume a first course in linear algebra. Every section closes with a summary of what should be retained and every chapter with exercises, several drawn from past examinations. Accompanying Python code reproduces the numerical illustrations.

math.NA↗

arXiv2026

Spectral coarse spaces based on indefinite operators: the $H_k$-GenEO method

GenEO (`Generalised Eigenvalue problems on the Overlap') is a method for constructing coarse spaces used in the preconditioning of iterative solvers for discrete PDEs. This method combines a (small) number of modes of local PDE eigenproblems to obtain a global coarse space. A coarse solve is then combined with local solves of the global PDE to obtain the preconditioner. A substantial theory for GenEO has been developed for the case when the local elgenproblems are positive semi-definite. This has been applied mostly to positive definite global PDEs, but also recently extended to the case of convection--diffusion--reaction problems, which may be neither self-adjoint, nor positive definite. However, when the global problem is highly indefinite, coarse spaces built from positive semi-definite local eigenproblems fail to be robust in practice. In this paper we consider highly indefinite global PDE problems, characterised by a large parameter $k$ (allowing also highly variable coefficients), and we develop a new spectral coarse space built from solving eigenvalue problems based on \textit{local copies of the global problem}. We put no constraint on the diameters of the local domains, thus allowing the local eigenvalue problems to be indefinite. The new method (which we call $H_k$-GenEO) is seen to be much more robust as $k$ increases than methods based on positive semi-definite eigenproblems. We provide sufficient conditions for robustness of the preconditioned GMRES iterative method, in terms of the tolerance of the local eigenproblems and the size of the subdomains for the local PDE solves. In practice the method is observed to be robust with respect to $k$ under even weaker conditions on the local eigenproblem tolerance. The experiments also suggest the method can be resilient to high variation in PDE coefficients.

math.NA↗

arXiv2026

A Guided Tour of Modern Domain Decomposition: From Schwarz Iterations to Robust Preconditioners and HPC Implementations

Domain decomposition methods (DDMs) provide a unifying framework for the scalable numerical solution of partial differential equations. Originating from Schwarz's alternating method, they have evolved into a rich family of algorithms that combine local robustness with global convergence acceleration and natural parallelism. Over the past decades, domain decomposition has played a central role in enabling large-scale simulations in numerous applications. This chapter presents an overview of modern DDMs, with a particular emphasis on scalable preconditioning techniques for challenging problems, including indefinite and high-frequency regimes. We revisit the fundamental concepts - overlapping decompositions, partition of unity, additive and restricted Schwarz formulations - and explain their algebraic interpretations. We then clarify their role as preconditioners in Krylov subspace solvers and discuss the necessity of coarse space corrections for scalability. Beyond a the survey aspect, the chapter distills key theoretical insights and practical design principles that have emerged over the past twenty years. Special attention is given to robust coarse spaces (GenEO, DtN-based approaches) and high-performance implementations. The goal is to provide both a coherent overview of the field and a concise, practice-oriented guide for readers seeking to understand and apply domain decomposition methods without navigating the entire literature.

math.NA↗

arXiv2026

When can a neural operator replace a coarse solve? Architectural principles for two-level preconditioning

Neural operators are increasingly used as accelerators inside classical numerical methods, but it is rarely clear which architectural ingredients matter for which application. We answer this question for one important use case: the coarse-space correction inside a two-level preconditioner for discretised linear partial differential equations. We systematically vary four DeepONet-like architectures along two design axes: input discretisation (sampling versus integration against a basis) and source-term linearity. In doing this, we show that the favourable corner of this 2$\times$2 design is occupied by a single architecture, the Neural Green's Operator (NGO), and that moving away from it produces predictable failure modes: structurally non-symmetric preconditioned spectra, breakdown of preconditioned conjugate gradients on self-adjoint problems, and stagnation on non-self-adjoint ones. Used as a coarse-space correction, the NGO matches the iteration count of an exact coarse solve on diffusion and advection-diffusion problems. The principle generalises: integrating inputs against the basis used for the output is what allows a neural operator to serve as a Galerkin-type coarse-space correction.

math.NA↗

arXiv2026

Are Deep Learning Based Hybrid PDE Solvers Reliable? Why Training Paradigms and Update Strategies Matter

Deep learning-based hybrid iterative methods (DL-HIMs) integrate classical numerical solvers with neural operators, utilizing their complementary spectral biases to accelerate convergence. Despite this promise, many DL-HIMs stagnate at false fixed points where neural updates vanish while the physical residual remains large, raising questions about reliability in scientific computing. In this paper, we provide evidence that performance is highly sensitive to training paradigms and update strategies, even when the neural architecture is fixed. Through a detailed study of a DeepONet-based hybrid iterative numerical transferable solver (HINTS) and an FFT-based Fourier neural solver (FNS), we show that significant physical residuals can persist when training objectives are not aligned with solver dynamics and problem physics. We further examine Anderson acceleration (AA) and demonstrate that its classical form is ill-suited for nonlinear neural operators. To overcome this, we introduce physics-aware Anderson acceleration (PA-AA), which minimizes the physical residual rather than the fixed-point update. Numerical experiments confirm that PA-AA restores reliable convergence in substantially fewer iterations. These findings provide a concrete answer to ongoing controversies surrounding AI-based PDE solvers: reliability hinges not only on architectures but on physically informed training and iteration design.

math.NA↗

arXiv2025

Neural network-driven domain decomposition for efficient solutions to the Helmholtz equation

Accurately simulating wave propagation is crucial in fields such as acoustics, electromagnetism, and seismic analysis. Traditional numerical methods, like finite difference and finite element approaches, are widely used to solve governing partial differential equations (PDEs) such as the Helmholtz equation. However, these methods face significant computational challenges when applied to high-frequency wave problems in complex two-dimensional domains. This work investigates Finite Basis Physics-Informed Neural Networks (FBPINNs) and their multilevel extensions as a promising alternative. These methods leverage domain decomposition, partitioning the computational domain into overlapping sub-domains, each governed by a local neural network. We assess their accuracy and computational efficiency in solving the Helmholtz equation for the homogeneous case, demonstrating their potential to mitigate the limitations of traditional approaches.

math.NA↗

arXiv2025

Preconditioning of GMRES for Helmholtz problems with quasimodes

Finite element methods are effective for Helmholtz problems involving complex geometries and heterogeneous media. However, the resulting linear systems are often large, indefinite, and challenging for iterative solvers, particularly at high wave numbers or near resonant conditions. We derive a GMRES convergence bound that incorporates the nonlinear behavior of the relative residual and relates convergence to harmonic Ritz values. This perspective reveals how small eigenvalues associated with quasimodes can hinder convergence, and when they cease to have an effect. These phenomena occur in domain decomposition, and we illustrate them through numerical experiments. We also combine domain decomposition methods with deflation techniques using (approximate) eigenvectors tailored to resonant regimes. Their impact on GMRES performance is evaluated.

math.NA↗

arXiv2025

Achieving wavenumber robustness in domain decomposition for heterogeneous Helmholtz equation: an overview of spectral coarse spaces

Solving time-harmonic wave propagation problems in the frequency domain within heterogeneous media poses significant mathematical and computational challenges, particularly in the high-frequency regime. Among the available numerical approaches, domain decomposition methods are widely regarded as effective due to their suitability for parallel computing and their capacity to maintain robustness with respect to physical parameters, such as the wavenumber. These methods can achieve near-constant time-to-solution as the wavenumber increases, though often at the expense of a computationally intensive coarse correction step. This work focuses on identifying the best algorithms and numerical strategies for benchmark problems modelled by the Helmholtz equation. Specifically, we examine and compare several coarse spaces which are part of different families, e.g. GenEO (Generalised Eigenvalue Overlap) type coarse spaces and harmonic coarse spaces, that underpin two-level domain decomposition methods. By leveraging spectral information and multiscale approaches, we aim to provide a comprehensive overview of the strengths and weaknesses of these methods. Numerical experiments demonstrate that the effectiveness of these coarse spaces depends on the specific problem and numerical configuration, highlighting the trade-offs between computational cost, robustness, and practical applicability.

math.NA↗

arXiv2025

Local Feature Filtering for Scalable and Well-Conditioned Domain-Decomposed Random Feature Methods

Random Feature Methods (RFMs) and their variants such as extreme learning machine finite-basis physics-informed neural networks (ELM-FBPINNs) offer a scalable approach for solving partial differential equations (PDEs) by using localized, overlapping and randomly initialized neural network basis functions to approximate the PDE solution and training them to minimize PDE residuals through solving structured least-squares problems. This combination leverages the approximation power of randomized neural networks and the parallelism of domain decomposition. However, the resulting least-squares systems are often severely ill-conditioned, due to local redundancy among random basis functions, which significantly affects the convergence of standard solvers. In this work, we introduce a block rank-revealing QR (RRQR) filtering and preconditioning strategy that operates directly on the structured least-squares problem. First, local RRQR factorizations identify and remove redundant basis functions while preserving numerically informative ones, reducing problem size, and improving conditioning. Second, we use these factorizations to construct a right preconditioner for the global problem which preserves block-sparsity and numerical stability. Third, we derive deterministic bounds of the condition number of the preconditioned system, with probabilistic refinements for small overlaps. We validate our approach on challenging, multi-scale PDE problems in 1D, 2D, and (2+1)D, demonstrating reductions in condition numbers by up to eleven orders of magnitude, LSQR convergence speedups by factors of 10-1000, and higher accuracy than both unpreconditioned and additive Schwarz-preconditioned baselines, all at significantly lower memory and computational cost. These results establish RRQR-based preconditioning as a scalable, accurate, and efficient enhancement for RFM-based PDE solvers.

math.NA↗

arXiv2025

Convergence analysis of GMRES applied to Helmholtz problems near resonances

The finite element solution of Helmholtz problems near resonant or quasi-resonant frequencies poses significant challenges, as iterative solvers typically suffer from severely degraded convergence. We analyze the convergence behavior of GMRES applied to linear systems arising from such configurations. Theoretical convergence estimates are derived based on harmonic Ritz values, highlighting their proximity to small eigenvalues as a key determining factor. We further examine deflation strategies and their interplay with preconditioning techniques, using the Complex Shifted Laplacian preconditioner as a case study. Numerical experiments on resonant and quasi-resonant test cases validate the theoretical framework and demonstrate the effectiveness of deflation strategies. This study provides new insights and practical guidance for analyzing and improving iterative solvers for time-harmonic problems near resonances.

math.NA↗

arXiv2025

Modal analysis of a domain decomposition method for Maxwell's equations in a waveguide

Time-harmonic wave propagation problems, especially those governed by Maxwell's equations, pose significant computational challenges due to the non-self-adjoint nature of the operators and the large, non-Hermitian linear systems resulting from discretization. Domain decomposition methods, particularly one-level Schwarz methods, offer a promising framework to tackle these challenges, with recent advancements showing the potential for weak scalability under certain conditions. In this paper, we analyze the weak scalability of one-level Schwarz methods for Maxwell's equations in strip-wise domain decompositions, focusing on waveguides with general cross sections and different types of transmission conditions such as impedance or perfectly matched layers (PMLs). By combining techniques from the limiting spectrum analysis of Toeplitz matrices and the modal decomposition of Maxwell's solutions, we provide a novel theoretical framework that extends previous work to more complex geometries and transmission conditions. Numerical experiments confirm that the limiting spectrum effectively predicts practical behavior even with a modest number of subdomains. Furthermore, we demonstrate that the one-level Schwarz method can achieve robustness with respect to the wave number under specific domain decomposition parameters, offering new insights into its applicability for large-scale electromagnetic wave problems.

math.NA↗

arXiv2025

An Iterative Block Matrix Inversion (IBMI) Algorithm for Symmetric Positive Definite Matrices with Applications to Covariance Matrices

Obtaining the inverse of a large symmetric positive definite matrix $\mathcal{A}\in\mathbb{R}^{p\times p}$ is a continual challenge across many mathematical disciplines. The computational complexity associated with direct methods can be prohibitively expensive, making it infeasible to compute the inverse. In this paper, we present a novel iterative algorithm (IBMI), which is designed to approximate the inverse of a large, dense, symmetric positive definite matrix. The matrix is first partitioned into blocks, and an iterative process using block matrix inversion is repeated until the matrix approximation reaches a satisfactory level of accuracy. We demonstrate that the two-block, non-overlapping approach converges for any positive definite matrix, while numerical results provide strong evidence that the multi-block, overlapping approach also converges for such matrices.

math.NA↗

arXiv2024

ELM-FBPINNs: An Efficient Multilevel Random Feature Method

Domain-decomposed variants of physics-informed neural networks (PINNs) such as finite basis PINNs (FBPINNs) mitigate some of PINNs' issues like slow convergence and spectral bias through localisation, but still rely on iterative nonlinear optimisation within each subdomain. In this work, we propose a hybrid approach that combines multilevel domain decomposition and partition-of-unity constructions with random feature models, yielding a method referred to as multilevel ELM-FBPINN. By replacing trainable subdomain networks with extreme learning machines, the resulting formulation eliminates backpropagation entirely and reduces training to a structured linear least-squares problem. We provide a systematic numerical study comparing ELM-FBPINNs and multilevel ELM-FBPINNs with standard PINNs and FBPINNs on representative benchmark problems, demonstrating that ELM-FBPINNs and multilevel ELM-FBPINNs achieve competitive accuracy while significantly accelerating convergence and improving robustness with respect to architectural and optimisation parameters. Through ablation studies, we further clarify the distinct roles of domain decomposition and random feature enrichment in controlling expressivity, conditioning, and scalability.

math.NA↗

arXiv2024

Two-level deep domain decomposition method

This study presents a two-level Deep Domain Decomposition Method (Deep-DDM) augmented with a coarse-level network for solving boundary value problems using physics-informed neural networks (PINNs). The addition of the coarse level network improves scalability and convergence rates compared to the single level method. Tested on a Poisson equation with Dirichlet boundary conditions, the two-level deep DDM demonstrates superior performance, maintaining efficient convergence regardless of the number of subdomains. This advance provides a more scalable and effective approach to solving complex partial differential equations with machine learning.

cs.LG↗

arXiv2024

Nonlinear Multilevel Solution Strategies for Diffusive Wave Flood Models in Perforated Domains

This article investigates the numerical solution of the Diffusive Wave equation posed on domains containing a large number of polygonal perforations, motivated by urban flood modeling. Such geometries induce strong multiscale effects driven by geometric complexity, which significantly challenge the robustness of standard nonlinear and linear solvers. The work builds on a multiscale coarse space previously introduced by the authors for linear Poisson problems on perforated domains. This low-dimensional space, constructed on a coarse polygonal partition and spanned by locally discrete harmonic (Trefftz-type) basis functions, is shown to remain effective for the linearized Diffusive Wave problems arising within Newton iterations. This enables the construction of robust two-level preconditioners for the resulting sequence of linear systems. Beyond linearization, the main focus of this work is on the effective solution of the fully nonlinear problem. We assess and combine several Schwarz-based nonlinear preconditioning strategies, including a two-level RASPEN method and a two-step nonlinear method, using the same multiscale coarse space to ensure scalability. While the individual components are drawn from the existing literature, their combination provides a robust and practical solution strategy for a challenging nonlinear problem posed on highly perforated domains. A systematic comparison of the methods and a discussion of algorithmic complexity are presented. The proposed approaches are validated through numerical experiments, including a realistic test case based on topographical data from the city of Nice.

math.NA↗

arXiv2024

Schwarz preconditioner with $H_k$-GenEO coarse space for the indefinite Helmholtz problem

GenEO (`Generalised Eigenvalue problems on the Overlap') is a method from the family of spectral coarse spaces that can efficiently rely on local eigensolves in order to build a robust parallel domain decomposition preconditioner for elliptic PDEs. When used as a preconditioner in a conjugate gradient, this method is extremely efficient in the positive-definite case, yielding an iteration count completely independent of the number of subdomains and heterogeneity. In a previous work this theory was extended to the cased of convection--diffusion--reaction problems, which may be non-self-adjoint and indefinite, and whose discretisations are solved with preconditioned GMRES. The GenEO coarse space was then defined here using a generalised eigenvalue problem based on a self-adjoint and positive definite subproblem. The resulting method, called $\Delta$-GenEO becomes robust with respect to the variation of the coefficient of the diffusion term in the operator and depends only very mildly on variations of the other coefficients. However, the iteration number estimates get worse as the non-self-adjointness and indefiniteness of the operator increases, which is often the case for the high frequency Helmholtz problems. In this work, we will improve on this aspect by introducing a new version, called $H_k$-GenEO, which uses a generalised eigenvalue problem based directly on the indefinite operator which will lead to a robust method with respect to the increase in the wave-number. We provide theoretical estimates showing the dependence of the size of the coarse space on the wave-number.

math.NA↗

arXiv2024

Can Symmetric Positive Definite (SPD) coarse spaces perform well for indefinite Helmholtz problems?

Wave propagation problems governed by the Helmholtz equation remain among the most challenging in scientific computing, due to their indefinite nature. Domain decomposition methods with spectral coarse spaces have emerged as some of the most effective preconditioners, yet their theoretical guarantees often lag behind practical performance. In this work, we introduce and analyse the $\Delta_k$-GenEO coarse space within the two-level additive Schwarz preconditioners for heterogeneous Helmholtz problems. This is an adaptation of the $\Delta$-GenEO coarse space. Our results sharpen the $k$-explicit conditions for GMRES convergence, reducing the restrictions on the subdomain size and eigenvalue threshold. This narrows the long-standing gap between pessimistic theory and empirical evidence, and reveals why GenEO spaces based on SPD (symmetric positive definite) eigenvalue problems remain surprisingly effective despite their apparent limitations. Numerical experiments confirm the theory, demonstrating scalability, robustness to heterogeneity for low to moderate frequencies (while experiencing limitations in the high frequency cases), and significantly milder coarse-space growth than conservative estimates predict.

math.NA↗

arXiv2023

A robust and adaptive GenEO-type domain decomposition preconditioner for $\mathbf{H}(\mathbf{curl})$ problems in three-dimensional general topologies

In this paper we design, analyse and test domain decomposition methods for linear systems of equations arising from conforming finite element discretisations of positive Maxwell-type equations, namely for $\mathbf{H}(\mathbf{curl})$ problems. It is well known that convergence of domain decomposition methods rely heavily on the efficiency of the coarse space used in the second level. We design adaptive coarse spaces that complement a near-kernel space made from the gradient of scalar functions. The new class of preconditioner is inspired by the idea of subspace decomposition, but based on spectral coarse spaces, and is specially designed for curl-conforming discretisations of Maxwell's equations in heterogeneous media on general domains which may have holes. We also address the practical robustness of various solvers in the case of non-trivial topologies and/or high aspect ratio of the domain.

math.NA↗