Optimization on Affine-Transversal Hilbert Submanifolds: Part I -- Theoretical Foundations

Abstract

In this paper, we establish the theoretical foundations for the generic optimization problem in a Hilbert space whose feasible set is an affine-transversal Hilbert submanifold given by the intersection of a nonlinear manifold and an affine subspace. We develop the geometric and analytical toolkit, such as the tangent-space characterization, projection operators, and implicit retraction operators, to essentially ensure the feasibility of iterates for algorithmic design. We also derive weak-form expressions for the derivatives of lifted objective functionals. In particular, we introduce a projection-induced Riemannian metric whose induced norm is uniformly equivalent to the ambient norm, under which the projection-induced gradient becomes an exact Riemannian gradient with an explicit formula. This construction replaces the implicit tangent-space Riesz representation underlying classical Riemannian optimization with directly computable operator evaluations, yielding a practical variable-metric framework for algorithmic design while preserving the geometric structure required for convergence analysis. With these theoretical foundations, it becomes possible to apply standard techniques in Euclidean spaces to design algorithms with strictly feasible iterates for the optimization problem on an affine-transversal Hilbert submanifold. We also propose the theoretical frameworks for algorithmic design on affine-transversal Hilbert submanifolds by showcasing the Riemannian line-search and trust-region algorithms with rigorous convergence analysis.