arXiv ScienceSearch

arXiv subjects

Hongjia Ou

Publications and source records attributed to Hongjia Ou.

4 recordsLinked to original sources

An Adaptive Linesearch-free Method for Monotone Variational Inequalities under Local Lipschitz Continuity

The forward-reflected-backward (FRB) splitting solves inclusion problems involving the sum of a maximally monotone operator and a monotone Lipschitz continuous operator. Each iteration performs one resolvent step and one evaluation of the Lipschitz operator, plus a reflection term with coefficient one that reuses the previous operator value. We consider the setting where the maximally monotone operator is the subdifferential of a proper, lower semicontinuous, convex function. We identify the tight admissible range of constant reflection coefficients, namely all values larger than one half for a sufficiently small stepsize. We then propose a linesearch-free adaptive variant of FRB for locally Lipschitz continuous operators, in which both the stepsize and the reflection coefficient change across iterations. The stepsize is computed in closed form from a simple local Lipschitz estimate, without requiring the existence or knowledge of a global Lipschitz constant, while maintaining the iteration cost of FRB. The analysis of both methods relies on a new Lyapunov function that combines the distance to a solution, successive differences of iterates, and a gap-type term. The individual terms need not decrease along the iterates, but the stepsize conditions ensure that their weighted combination does. Moreover, alongside nonasymptotic rates, we derive explicit lower bounds on the generated stepsizes, and showcase the effectiveness of the adaptive method through numerical experiments on minimax problems, equilibrium models, and regularized regression.

math.OC

Linesearch-free adaptive Bregman proximal gradient for convex minimization under local relative smoothness

This paper introduces adaptive Bregman proximal gradient algorithms for solving convex composite minimization problems without relying on global relative smoothness or strong convexity assumptions. Building upon recent advances in adaptive stepsize selections, the proposed methods generate stepsizes based on local curvature estimates, entirely eliminating the need for backtracking linesearch. A key tool in our analysis is a Bregman generalization of Young's inequality, which allows the control of a critical inner product in terms of the same Bregman distances used in the updates. Our theory applies to problems where the differentiable term is merely \emph{locally} smooth relative to a distance-generating function, without requiring the existence of global moduli or symmetry coefficients. Numerical experiments demonstrate their competitive performance compared to existing approaches across various problem classes.

math.OC

Safeguarding adaptive methods: global convergence of Barzilai-Borwein and other stepsize choices

Leveraging on recent advancements on adaptive methods for convex minimization problems, this paper provides a linesearch-free proximal gradient framework for globalizing the convergence of popular stepsize choices such as Barzilai-Borwein and one-dimensional Anderson acceleration. This framework can cope with problems in which the gradient of the differentiable function is merely locally Hölder continuous. Our analysis not only encompasses but also refines existing results upon which it builds. The theory is corroborated by numerical evidence that showcases the synergetic interplay between fast stepsize selections and adaptive methods.

math.OC

A mirror inertial forward-reflected-backward splitting: Global convergence and linesearch extension beyond convexity and Lipschitz smoothness

This work investigates a Bregman and inertial extension of the forward-reflected-backward algorithm [Y. Malitsky and M. Tam, SIAM J. Optim., 30 (2020), pp. 1451--1472] applied to structured nonconvex minimization problems under relative smoothness. To this end, the proposed algorithm hinges on two key features: taking inertial steps in the dual space, and allowing for possibly negative inertial values. Our analysis begins with studying an associated envelope function that takes inertial terms into account through a novel product space formulation. Such construction substantially differs from similar objects in the literature and could offer new insights for extensions of splitting algorithms. Global convergence and rates are obtained by appealing to the generalized concave Kurdyka-Lojasiewicz (KL) property, which allows us to describe a sharp upper bound on the total length of iterates. Finally, a linesearch extension is given to enhance the proposed method.

math.OC