arXiv subjects

Leo Rebholz

Publications and source records attributed to Leo Rebholz.

7 recordsLinked to original sources

arXiv2026

On a blended Anderson / NGMRES acceleration for the Navier-Stokes Picard iteration: convergence analysis and adaptive depth selection

Anderson acceleration (AA) and nonlinear GMRES (NGMRES) have been successfully applied to improve the efficiency and robustness of many nonlinear solvers, with each being shown to have certain advantages over the other. There are two differences between the AA and NGMRES algorithms: the extrapolations are different, and AA uses fixed point residuals in the optimization problem while NGMRES uses true nonlinear residuals. Motivated by recent AA and NGMRES analyses and numerical testing, we consider a blend of AA and NGMRES that uses the AA extrapolation and the true nonlinear residuals for the optimization problem. To focus our study, we consider the blended method applied to the Picard iteration for the Navier-Stokes equations, but many of the ideas developed herein are extendable to a wide variety of nonlinear systems and solvers. We provide a convergence analysis and proof of acceleration of the blended method, provide a detailed numerical comparison of AA, NMGRES and the blended method for several benchmark tests, and develop an effective adaptive depth strategy.

math.NA↗

arXiv2025

On the choice of optimization norm for Anderson acceleration of the Picard iteration for Navier-Stokes equations

While the most recent Anderson acceleration (AA) convergence theory [Pollock et al, {\it IMA Num. An.}, 2021] requires that the AA optimization norm match the Hilbert space norm associated with the fixed point operator, in implementations the $\ell^2$ norm is perhaps the most common choice. Unfortunately, so far there is little research done regarding this discrepancy which might reveal when it is fine to use $\ell^2$. To address this issue, we consider AA applied to the Picard iteration for the Navier-Stokes equations (NSE) with varying choices of the AA optimization norm. We first prove a sharpened and generalized convergence estimate for depth $m$ AA-Picard for the NSE with the $H^1_0$ AA optimization norm by using a problem-specific analysis, utilizing a sharper treatment of the nonlinear terms than previous AA-Picard convergence studies, removing a small data assumption, and developing new AA term identities in the NSE nonlinear term estimates. Next, we prove a convergence result for when $L^2$ is used as the AA optimization norm, and this estimate is found to be very similar to that of the $H^1_0$ case. While no analogous theory seems possible for the $\ell^2$ norm, several numerical tests were run to compare AA-Picard convergence with varying choices of AA optimization norm. These tests revealed that convergence behavior was always similar for $L^2$ and $H^1_0$ and {\it usually but not always} similar for $\ell^2$: on a test problem for channel flow past a cylinder with coarser meshes, convergence of AA-Picard using $\ell^2$ performs significantly worse than using $L^2$ and $H^1_0$.

math.NA↗

arXiv2024

Analysis of the Picard-Newton iteration for the Navier-Stokes equations: global stability and quadratic convergence

We analyze and test a simple-to-implement two-step iteration for the incompressible Navier-Stokes equations that consists of first applying the Picard iteration and then applying the Newton iteration to the Picard output. We prove that this composition of Picard and Newton converges quadratically, and our analysis (which covers both the unique solution and non-unique solution cases) also suggests that this solver has a larger convergence basin than usual Newton because of the improved stability properties of Picard-Newton over Newton. Numerical tests show that Picard-Newton dramatically outperforms both the Picard and Newton iterations, especially as the Reynolds number increases. We also consider enhancing the Picard step with Anderson acceleration (AA), and find that the AAPicard-Newton iteration has even better convergence properties on several benchmark test problems.

math.NA↗

arXiv2024

Enhancing nonlinear solvers for the Navier-Stokes equations with continuous (noisy) data assimilation

We consider nonlinear solvers for the incompressible, steady (or at a fixed time step for unsteady) Navier-Stokes equations in the setting where partial measurement data of the solution is available. The measurement data is incorporated/assimilated into the solution through a nudging term addition to the the Picard iteration that penalized the difference between the coarse mesh interpolants of the true solution and solver solution, analogous to how continuous data assimilation (CDA) is implemented for time dependent PDEs. This was considered in the paper [Li et al. {\it CMAME} 2023], and we extend the methodology by improving the analysis to be in the $L^2$ norm instead of a weighted $H^1$ norm where the weight depended on the coarse mesh width, and to the case of noisy measurement data. For noisy measurement data, we prove that the CDA-Picard method is stable and convergent, up to the size of the noise. Numerical tests illustrate the results, and show that a very good strategy when using noisy data is to use CDA-Picard to generate an initial guess for the classical Newton iteration.

math.NA↗

arXiv2022

Improved long time accuracy for projection methods for Navier-Stokes equations using EMAC formulation

We consider a pressure correction temporal discretization for the incompressible Navier-Stokes equations in EMAC form. We prove stability and error estimates for the case of mixed finite element spatial discretization, and in particular that the Gronwall constant's exponential dependence on the Reynolds number is removed (for sufficiently smooth true solutions) or at least significantly reduced compared to the commonly used skew-symmetric formulation. We also show the method preserves momentum and angular momentum, and while it does not preserve energy it does admit an energy inequality. Several numerical tests show the advantages EMAC can have over other commonly used formulations of the nonlinearity. Additionally, we discuss extensions of the results to the usual Crank-Nicolson temporal discretization.

math.NA↗

arXiv2019

Anderson acceleration for contractive and noncontractive operators

A one-step analysis of Anderson acceleration with general algorithmic depths is presented. The resulting residual bounds within both contractive and noncontractive settings reveal the balance between the contributions from the higher and lower order terms, which are both dependent on the success of the optimization problem solved at each step of the algorithm. The new residual bounds show the additional terms introduced by the extrapolation produce terms that are of a higher order than was previously understood. In the contractive setting, these bounds sharpen previous convergence and acceleration results. The bounds rely on sufficient linear independence of the differences between consecutive residuals, rather than assumptions on the boundedness of the optimization coefficients, allowing the introduction of a theoretically sound safeguarding strategy. Several numerical tests illustrate the analysis primarily in the noncontractive setting, and demonstrate the use of the method, the safeguarding strategy, and theory-based guidance on dynamic selection of the algorithmic depth, on a p-Laplace equation, a nonlinear Helmholtz equation, and the steady Navier-Stokes equations with high Reynolds number in three spatial dimensions.

math.NA↗

arXiv2018

Global well-posedness of the velocity-vorticity-Voigt model of the 3D Navier-Stokes equations

The velocity-vorticity formulation of the 3D Navier-Stokes equations was recently found to give excellent numerical results for flows with strong rotation. In this work, we propose a new regularization of the 3D Navier-Stokes equations, which we call the 3D velocity-vorticity-Voigt (VVV) model, with a Voigt regularization term added to momentum equation in velocity-vorticity form, but with no regularizing term in the vorticity equation. We prove global well-posedness and regularity of this model under periodic boundary conditions. We prove convergence of the model's velocity and vorticity to their counterparts in the 3D Navier-Stokes equations as the Voigt modeling parameter tends to zero. We prove that the curl of the model's velocity converges to the model vorticity (which is solved for directly), as the Voigt modeling parameter tends to zero. Finally, we provide a criterion for finite-time blow-up of the 3D Navier-Stokes equations based on this inviscid regularization.

math.AP↗