arXiv subjects

Jérémy Rieussec

Publications and source records attributed to Jérémy Rieussec.

3 recordsLinked to original sources

arXiv2026

Structural conditions on trust-region radius updates. Part I: first-order convergence and complexity

Trust-region methods differ chiefly in how they update the radius, and each rule has traditionally been analysed on its own terms. We show that three structural conditions on the radius sequence suffice: a lower bound relative to the gradient norm, a contraction on unsuccessful iterations, and a controlled expansion on successful ones. A mechanism is weakly admissible if it satisfies the first two, and strongly admissible if it satisfies the first and third. Strong admissibility yields the optimal worst-case complexity $\mathcal{O}(\varepsilon^{-2})$ for first-order stationarity, and extends global convergence to model Hessians growing linearly with the iteration; weak admissibility gives $\lim_{k\to\infty}\|\nabla f(x_k)\| = 0$ under uniformly bounded model Hessians. Both hold for every rule in the class, so a new mechanism is covered by verifying two inequalities rather than by a fresh convergence proof. We verify admissibility for five mechanism classes (fixed-factor, step-driven, retrospective, criticality-anchored and gradient-scaled), prove convergence of the retrospective update under linearly growing model Hessians, and extend the Lyapunov framework of Curtis and Scheinberg (2020), Wang and Yuan (2022) to three distinct scaling factors with decoupled step acceptance, covering $η= 0$; its stochastic version specialises to the deterministic gradient-scaled rule. Part II treats the asymptotic behaviour of the radius and convergence to second-order critical points.

math.OC↗

arXiv2026

A numerical study of radius update rules in trust-region algorithms

Part I [arXiv:2606.30202] and Part II establish which trust-region radius update mechanisms can fail and under which hypotheses they must succeed. Neither says where the thresholds sit once a rule runs with real constants, or how the rule interacts with the model Hessian and the subproblem solver. This paper turns them into nine falsifiable claims and settles what it can, on four designed problems where the theory's quantities are computable and on CUTEst, where only aggregate cost is visible. Every mechanism runs in one Julia package written for this study, so two runs differing in one component differ in nothing else. The rule is worth less than the model and more than nothing. Crossing the mechanisms with four model Hessians puts $96.5$ per cent of the variation on the model and $1.6$ on the rule, and the rules separate most under the most accurate model rather than least. Uncapped R-grad is the robust default among the criticality-anchored rules, though the retrospective rule is ahead of it on this collection. No constant escapes the side conditions. For every cap there is a minimiser at which the constraint stays active, and for every anchoring constant a flatness on which escape takes arbitrarily long. The second of these is proved here as well as measured, and the proof uses no property of the model or of the subproblem solution beyond $\|s_k\| \leq Δ_k$. The radius rule governs the length of the step, and so the cost of a run. The model decides the search direction, and with it whether the run converges at all.

math.OC↗

arXiv2026

Structural conditions on trust-region radius updates. Part II: second-order convergence and asymptotic radius behaviour

Continuing Part I (arXiv:2606.30202), we ask not which structural conditions on $\{Δ_k\}$ suffice for global convergence but what the radius does; the answers separate the mechanisms by whether the radius is tied to a criticality measure. We identify three asymptotic regimes: the criticality-anchored rules give $\sum_k Δ_k^2/M_k < +\infty$, hence $\liminf_k Δ_k = 0$, and $Δ_k \to 0$ once the model Hessians are bounded; the step-driven rules inherit the summability of the step series, hence $\sum_k Δ_k < +\infty$; the fixed-factor rules keep $Δ_k$ bounded away from zero. Near a critical point with positive definite Hessian, convergence of a subsequence forces convergence of the full sequence. We then extend the framework to second-order criticality through $τ_k = \max\{\|g_k\|, -λ_k^-\}$, obtaining convergence to second-order critical points with the worst-case complexity $\mathcal{O}(\max\{\varepsilon_g^{-2}\varepsilon_H^{-1}, \varepsilon_H^{-3}\})$, which reduces to $\mathcal{O}(\varepsilon^{-3})$ for a common tolerance and is sharp for quadratic models. Finally we establish eventual inactivity of the constraint and superlinear convergence, isolating the two properties of the radius rule through which the mechanism enters; the rate itself is mechanism-independent. The criticality-anchored and capped gradient-scaled rules reach inactivity only under a side condition, $ζ> \overlineκ$ or $\overlineμ > \overlineκ$, with $\overlineκ$ a constant of the solution that cannot be checked in advance. These conditions are necessary, not artefacts: on $f(x) = \sin(x)/x$, $\overlineκ$ is unbounded over the minimisers, so no parameter value meets the condition at all of them. Among the rules tied to a criticality measure, only those with an unbounded multiplier escape such a constant.

math.OC↗