Complexity of Multiblock Convex-Concave Saddle-Point Problems with General Smooth Coupling

Abstract

We study multiblock convex--concave saddle-point problems of the form $\min_x\max_y\{f(x)+H(x,y)-g(y)\}$, with separately charged partial-gradient oracles for all three objective components. We impose joint smoothness and strong convexity bounds on the functions $f$ and $g$, together with blockwise Lipschitz conditions on the partial gradients of $H$, so that the resulting oracle complexities reflect the smoothness and dependency parameters specific to each oracle. Under strong convexity, we develop a randomized lifted extragradient method that achieves linear convergence while providing simultaneous complexity guarantees for all oracles. The partial-gradient complexities for $f$ and $g$ exhibit the expected square-root dependence on the corresponding block condition numbers, whereas the coupling-gradient complexities depend on the associated curvature-normalized smoothness parameters. Finite-dimensional bilinear subclasses provide lower-complexity benchmarks within a randomized blockwise linear-span model. When strong convexity of $f$ and $g$ is not assumed, a regularization argument yields expected restricted-gap guarantees with accuracy dependence $\varepsilon^{-1/2}$ for the objective-gradient oracles and $\varepsilon^{-1}$ for the coupling-gradient oracles, up to logarithmic factors. Experiments show observed oracle savings and runtime improvements in regimes of poor objective conditioning.