Proximal Gradient Descent Ascent Methods for Nonsmooth Nonconvex-Concave Minimax Problems on Riemannian Manifolds

Abstract

Nonsmooth nonconvex-concave minimax problems have attracted significant attention due to their wide applications in many fields. In this paper, we consider a class of nonsmooth nonconvex-concave minimax problems on Riemannian manifolds. Owing to the nonsmoothness of the objective function, existing minimax manifold optimization methods cannot be directly applied to solve this problem. We propose two manifold proximal gradient descent ascent (MPGDA) algorithms for solving the problem. The first algorithm alternatively performs one or multiple manifold proximal gradient descent steps and a proximal ascent step at each iteration, and we prove that it can find an $\varepsilon$-game-stationary point and an $\varepsilon$-optimization-stationary point within $\mathcal{O}(\varepsilon^{-3})$ outer iterations. The second algorithm alternatively performs one manifold proximal gradient descent step and a proximal gradient ascent step, and we show that it can reach an $\varepsilon$-game-stationary point and an $\varepsilon$-optimization-stationary point within $\mathcal{O}(\varepsilon^{-4})$ outer iterations. Numerical experiments on an analytic example, fair sparse PCA, and sparse spectral clustering are conducted to illustrate the advantages of the proposed algorithms.