arXiv Science⌕ Search

arXiv subjects

Kui Du

Publications and source records attributed to Kui Du.

At least 19 recordsLinked to original sources
arXiv2026

TriCG with deflated restarting for symmetric quasi-definite linear systems

TriCG is a short-recurrence iterative method recently introduced by Montoison and Orban [SIAM J. Sci. Comput., 43 (2021), pp. A2502--A2525] for solving symmetric quasi-definite (SQD) linear systems. TriCG takes advantage of the inherent block structure of SQD linear systems and performs substantially better than SYMMLQ. However, numerical experiments have revealed that the convergence of TriCG can be notably slow when the off-diagonal block contains a substantial number of large elliptic singular values. To address this limitation, we introduce a deflation strategy tailored for TriCG to improve its convergence behavior. Specifically, we develop a generalized Saunders--Simon--Yip process with deflated restarting to construct the deflation subspaces. Building upon this process, we propose a novel method termed TriCG with deflated restarting. The deflation subspaces can also be utilized to solve SQD linear systems with multiple right-hand sides. Numerical experiments are provided to illustrate the superior performance of the proposed methods.

math.NA↗
arXiv2025

GP-CMRH: An inner product free iterative method for block two-by-two nonsymmetric linear systems

We propose an inner product free iterative method called GP-CMRH for solving block two-by-two nonsymmetric linear systems. GP-CMRH relies on a new simultaneous Hessenberg process that reduces two rectangular matrices to upper Hessenberg form simultaneously, without employing inner products. Compared with GPMR [SIAM J. Matrix Anal. Appl., 44 (2023), pp. 293--311], GP-CMRH requires less computational cost per iteration and may be more suitable for high performance computing and low or mixed precision arithmetic due to its inner product free property. Our numerical experiments demonstrate that GP-CMRH and GPMR exhibit comparable convergence behavior (with GP-CMRH requiring slightly more iterations), yet GP-CMRH consumes less computational time in most cases. GP-CMRH significantly outperforms GMRES and CMRH in terms of convergence rate and runtime efficiency.

math.NA↗
arXiv2024

Obtaining the pseudoinverse solution of singular range-symmetric linear systems with GMRES-type methods

It is well known that for singular inconsistent range-symmetric linear systems, the generalized minimal residual (GMRES) method determines a least squares solution without breakdown. The reached least squares solution may be or not be the pseudoinverse solution. We show that a lift strategy can be used to obtain the pseudoinverse solution. In addition, we propose a new iterative method named RSMAR (minimum $\mathbf A$-residual) for range-symmetric linear systems $\mathbf A\mathbf x=\mathbf b$. At step $k$ RSMAR minimizes $\|\mathbf A\mathbf r_k\|$ in the $k$th Krylov subspace generated with $\{\mathbf A, \mathbf r_0\}$ rather than $\|\mathbf r_k\|$, where $\mathbf r_k$ is the $k$th residual vector and $\|\cdot\|$ denotes the Euclidean vector norm. We show that RSMAR and GMRES terminate with the same least squares solution when applied to range-symmetric linear systems. We provide two implementations for RSMAR. Our numerical experiments show that RSMAR is the most suitable method among GMRES-type methods for singular inconsistent range-symmetric linear systems.

math.NA↗
arXiv2024

GPBiLQ and GPQMR: Two iterative methods for unsymmetric partitioned linear systems

We introduce two iterative methods, GPBiLQ and GPQMR, for solving unsymmetric partitioned linear systems. The basic mechanism underlying GPBiLQ and GPQMR is a novel simultaneous tridiagonalization via biorthogonality that allows for short-recurrence iterative schemes. Similar to the biconjugate gradient method, it is possible to develop another method, GPBiCG, whose iterate (if it exists) can be obtained inexpensively from the GPBiLQ iterate. Whereas the iterate of GPBiCG may not exist, the iterates of GPBiLQ and GPQMR are always well defined as long as the biorthogonal tridiagonal reduction process does not break down. We discuss connections between the proposed methods and some existing methods, and give numerical experiments to illustrate the performance of the proposed methods.

math.NA↗
arXiv2023

On Krylov subspace methods for skew-symmetric and shifted skew-symmetric linear systems

Krylov subspace methods for solving linear systems of equations involving skew-symmetric matrices have gained recent attention. Numerical equivalences among Krylov subspace methods for nonsingular skew-symmetric linear systems have been given in Greif et al. [SIAM J. Matrix Anal. Appl., 37 (2016), pp. 1071--1087]. In this work, we extend the results of Greif et al. to singular skew-symmetric linear systems. In addition, we systematically study three Krylov subspace methods (called S$^3$CG, S$^3$MR, and S$^3$LQ) for solving shifted skew-symmetric linear systems. They all are based on Lanczos triangularization for skew-symmetric matrices, and correspond to CG, MINRES, and SYMMLQ for solving symmetric linear systems, respectively. To the best of our knowledge, this is the first work that studies S$^3$LQ. We give some new theoretical results on S$^3$CG, S$^3$MR, and S$^3$LQ. We also provide the relationship among the three methods and those based on Golub--Kahan bidiagonalization and Saunders--Simon--Yip tridiagonalization. Numerical examples are given to illustrate our theoretical findings.

math.NA↗
arXiv2022

Preferred corrosion pathways for oxygen in Al2Ca-twin boundaries and dislocations

With an ongoing discussion on the oxygen diffusion along crystal defects remaining, it is difficult to study this phenomenon in Al containing intermetallic materials due to its rapid and passivating oxide formation. We report here the observation of enhanced oxygen diffusion along crystal defects, i.e. dislocations and twin boundaries, in the C15 Al 2 Ca Laves phase and how the presence of oxygen induces structural changes at these defects. Three main phases were identified and characterized structurally by aberration-corrected, atomic resolution scanning transmission electron microscopy, analytically by energy dispersive X-ray spectroscopy and electron energy loss spectroscopy. Unlike the C15 bulk phase, the twin boundary and dislocation transformed into a few nanometer wide amorphous phase, which depletes in Al and Ca but is highly enriched in oxygen. The dislocation even shows coexistence of the amorphous phase with a simple Al-rich A1 fcc phase. This A1 phase only depletes in Ca, not in Al (Al remains at bulk concentration), and is also enriched in oxygen. The Al-rich A1 phase is coherent with the C15 matrix. Electron energy loss spectroscopy revealed the amorphous phase to be Al 2 O 3 . We thereby show as one of the first studies that oxygen diffusion along crystal defects, especially also at the twin boundary can induce the formation of an amorphous oxide along themselves. The identification of oxygen-induced transformation at strained defects has to be considered when the material is exposed to air during plastic deformation at elevated temperatures.

cond-mat.mtrl-sci↗
arXiv2022

Regularized randomized iterative algorithms for factorized linear systems

Randomized iterative algorithms for solving a factorized linear system, $\mathbf A\mathbf B\mathbf x=\mathbf b$ with $\mathbf A\in{\mathbb{R}}^{m\times \ell}$, $\mathbf B\in{\mathbb{R}}^{\ell\times n}$, and $\mathbf b\in{\mathbb{R}}^m$, have recently been proposed. They take advantage of the factorized form and avoid forming the matrix $\mathbf C=\mathbf A\mathbf B$ explicitly. However, they can only find the minimum norm (least squares) solution. In contrast, the regularized randomized Kaczmarz (RRK) algorithm can find solutions with certain structures from consistent linear systems. In this work, by combining the randomized Kaczmarz algorithm or the randomized Gauss--Seidel algorithm with the RRK algorithm, we propose two novel regularized randomized iterative algorithms to find (least squares) solutions with certain structures of $\mathbf A\mathbf B\mathbf x=\mathbf b$. We prove linear convergence of the new algorithms. Computed examples are given to illustrate that the new algorithms can find sparse (least squares) solutions of $\mathbf A\mathbf B\mathbf x=\mathbf b$ and can be better than the existing randomized iterative algorithms for the corresponding full linear system $\mathbf C\mathbf x=\mathbf b$ with $\mathbf C=\mathbf A\mathbf B$.

math.NA↗
arXiv2021

Randomized regularized extended Kaczmarz algorithms for tensor recovery

Randomized regularized Kaczmarz algorithms have recently been proposed to solve tensor recovery models with {\it consistent} linear measurements. In this work, we propose a novel algorithm based on the randomized extended Kaczmarz algorithm (which converges linearly in expectation to the unique minimum norm least squares solution of a linear system) for tensor recovery models with {\it inconsistent} linear measurements. We prove the linear convergence in expectation of our algorithm. Numerical experiments on a tensor least squares problem and a sparse tensor recovery problem are given to illustrate the theoretical results.

math.NA↗
arXiv2020

Pseudoinverse-free randomized block iterative algorithms for consistent and inconsistent linear systems

Randomized iterative algorithms have attracted much attention in recent years because they can approximately solve large-scale linear systems of equations without accessing the entire coefficient matrix. In this paper, we propose two novel pseudoinverse-free randomized block iterative algorithms for solving consistent and inconsistent linear systems. The proposed algorithms require two user-defined random matrices: one for row sampling and the other for column sampling. We can recover the well-known doubly stochastic Gauss--Seidel, randomized Kaczmarz, randomized coordinate descent, and randomized extended Kaczmarz algorithms by choosing appropriate random matrices used in our algorithms. Because our algorithms allow for a much wider selection of these two random matrices, a number of new specific algorithms can be obtained. We prove the linear convergence in the mean square sense of our algorithms. Numerical experiments for linear systems with synthetic and real-world coefficient matrices demonstrate the efficiency of some special cases of our algorithms.

math.NA↗
arXiv2020

Randomized double and triple Kaczmarz for solving extended normal equations

The randomized Kaczmarz algorithm has received considerable attention recently because of its simplicity, speed, and the ability to approximately solve large-scale linear systems of equations. In this paper we propose randomized double and triple Kaczmarz algorithms to solve extended normal equations of the form $\bf A^\top Ax=A^\top b-c$. The proposed algorithms avoid forming $\bf A^\top A$ explicitly and work for {\it arbitrary} $\mbf A\in\mbbr^{m\times n}$ (full rank or rank deficient, $m\geq n$ or $m<n$). {\it Tight} upper bounds showing exponential convergence in the mean square sense of the proposed algorithms are presented and numerical experiments are given to illustrate the theoretical results.

math.NA↗
arXiv2020

Stochastic gradient descent for linear least squares problems with partially observed data

We propose a novel stochastic gradient descent method for solving linear least squares problems with partially observed data. Our method uses submatrices indexed by a randomly selected pair of row and column index sets to update the iterate at each step. Theoretical convergence guarantees in the mean square sense are provided. Numerical experiments are reported to demonstrate the theoretical findings.

math.NA↗
arXiv2020

A doubly stochastic block Gauss-Seidel algorithm for solving linear equations

We propose a simple doubly stochastic block Gauss--Seidel algorithm for solving linear systems of equations. By varying the row partition parameter and the column partition parameter of the coefficient matrix, we recover the Landweber algorithm, the randomized Kaczmarz algorithm, the randomized Gauss--Seidel algorithm, and the doubly stochastic Gauss--Seidel algorithm. For general (consistent or inconsistent) linear systems, we show the exponential convergence of the {\it norms of the expected iterates} via exact formulas. For consistent linear systems, we prove the exponential convergence of the {\it expected norms of the error and the residual}. Numerical experiments are given to illustrate the efficiency of the proposed algorithm.

math.NA↗
arXiv2020

Randomized extended block Kaczmarz for solving least squares

Randomized iterative algorithms have recently been proposed to solve large-scale linear systems. In this paper, we present a simple randomized extended block Kaczmarz algorithm that exponentially converges in the mean square to the unique minimum $\ell_2$-norm least squares solution of a given linear system of equations. The proposed algorithm is pseudoinverse-free and therefore different from the projection-based randomized double block Kaczmarz algorithm of Needell, Zhao, and Zouzias. We emphasize that our method works for all types of linear systems (consistent or inconsistent, overdetermined or underdetermined, full-rank or rank-deficient). Moreover, our approach can utilize efficient implementations on distributed computing units, yielding remarkable improvements in computational time. Numerical examples are given to show the efficiency of the new algorithm.

math.NA↗
arXiv2018

Refined upper bounds for the convergence of the randomized extended Kaczmarz and Gauss-Seidel algorithms

The randomized extended Kaczmarz and Gauss-Seidel algorithms have attracted much attention because of their ability to treat all types of linear systems (consistent or inconsistent, full rank or rank-deficient). In this paper, we interpret the randomized extended Kaczmarz and Gauss-Seidel algorithms as specific combinations of the randomized Kaczmarz and Gauss-Seidel algorithms and present refined upper bounds for their convergence.

math.NA↗
arXiv2015

On well-conditioned spectral collocation and spectral methods by the integral reformulation

Well-conditioned spectral collocation and spectral methods have recently been proposed to solve differential equations. In this paper, we revisit the well-conditioned spectral collocation methods proposed in [T.~A. Driscoll, {\it J. Comput. Phys.}, 229 (2010), pp.~5980-5998] and [L.-L. Wang, M.~D. Samson, and X.~Zhao, {\it SIAM J. Sci. Comput.}, 36 (2014), pp.~A907--A929], and the ultraspherical spectral method proposed in [S.~Olver and A.~Townsend, {\it SIAM Rev.}, 55 (2013), pp.~462--489] for an $m$th-order ordinary differential equation from the viewpoint of the integral reformulation. Moreover, we propose a Chebyshev spectral method for the integral reformulation. The well-conditioning of these methods is obvious by noting that the resulting linear operator is a compact perturbation of the identity. The adaptive QR approach for the ultraspherical spectral method still applies to the almost-banded infinite-dimensional system arising in the Chebyshev spectral method for the integral reformulation. Numerical examples are given to confirm the well-conditioning of the Chebyshev spectral method.

math.NA↗
arXiv2015

Preconditioning fractional spectral collocation

Fractional spectral collocation (FSC) method based on fractional Lagrange interpolation has recently been proposed to solve fractional differential equations. Numerical experiments show that the linear systems in FSC become extremely ill-conditioned as the number of collocation points increases. By introducing suitable fractional Birkhoff interpolation problems, we present fractional integration preconditioning matrices for the ill-conditioned linear systems in FSC. The condition numbers of the resulting linear systems are independent of the number of collocation points. Numerical examples are given.

math.NA↗
arXiv2015

Preconditioning rectangular spectral collocation

Rectangular spectral collocation (RSC) methods have recently been proposed to solve linear and nonlinear differential equations with general boundary conditions and/or other constraints. The involved linear systems in RSC become extremely ill-conditioned as the number of collocation points increases. By introducing suitable Birkhoff-type interpolation problems, we present pseudospectral integration preconditioning matrices for the ill-conditioned linear systems in RSC. The condition numbers of the preconditioned linear systems are independent of the number of collocation points. Numerical examples are given.

math.NA↗