arXiv Science⌕ Search

arXiv · 2611.09719

Row-sparse ah-symmetric reflexive generalized inverses with a few extra rows: local search with approximation guarantees

Abstract

For a rank-$r$ matrix $A\in\mathbb{R}^{m\times n}$, ah-symmetric reflexive generalized inverses $H$ with few nonzero rows give least-squares solutions that are fast to evaluate and use few variables. A known determinant-based local search finds one with exactly $r$ nonzero rows and 2,1-norm within an essentially tight factor $r$ of the minimum at an exact local optimum. We let the nonzero rows of $H$ lie in a set $K$ of $k\ge r$ indices and study how to choose $K$. We bound the loss of this restriction (restricted over unrestricted minimum 2,1-norm) by a simple geometric certificate and establish that a local search maximizing the squared rank-$r$ volume of the corresponding columns of $A$ gives loss at most $\sqrt{k(r+εk)/(k-r+1)}$, where $1+ε$ is the swap tolerance. With $ε=0$ this is $r$ at $k=r$ and less than $\sqrt{2r}$ for $k\ge2r$; with $ε=1/k$ the search runs in polynomial time on rational data. The same support yields an ah-symmetric reflexive generalized inverse with spectral norm within a factor $\sqrt{1+(n-k)(r+εk)/(k-r+1)}$ of that of the Moore-Penrose pseudoinverse. The loss guarantees hold for every norm on the rows. In general, our certificate bound is tight up to a factor depending only on $k/r$, and on some instances, for a suitable row norm, so is the loss bound; for the 2,1-norm, however, the certificate can overestimate the loss by a factor $\sqrt r$. The local search is the Fedorov exchange algorithm of 0/1 D-optimal design; this yields a fast implementation and, via the Kiefer-Wolfowitz theorem, supports of at most $r(r+1)/2+1$ rows with certificate at most $\sqrt r$, best possible in general. On instances from earlier work, the observed loss is far below the guarantee, and the method matches two ADMM heuristics when few rows are removed and otherwise gives 2,1-norms up to 27% smaller, one to two orders of magnitude faster.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Marcia Fampa, Jon Lee. 2026-11-06. Row-sparse ah-symmetric reflexive generalized inverses with a few extra rows: local search with approximation guarantees. https://arxiv.org/abs/2611.09719

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Integer matrices that are not copositive have certificates of less than quadratic complexity

A real symmetric matrix is called copositive if the corresponding quadratic form is non-negative on the closed first orthant. If the matrix fails to be copositive there exists some non-negative certificate for which the quadratic form is negative. Due to the scaling property, we can find such certificates in every neighborhood of the origin but their properties depend on the matrix of course and are hard to describe. If it is an integer matrix however, we are guaranteed certificates of a complexity that is at most a constant times the binary encoding length of the matrix raised to the power 3/2.

math.OC↗

Kernel Metrics and Learning for Borel MDPs: Identifiability and Adaptive Control

We consider a Markov decision process with standard Borel spaces and an unknown transition kernel under the average cost criterion. We do not impose any parametrization on the set of possible kernels. To facilitate our analysis, we first develop implication relations between several topologies on kernels defined by pointwise, continuous, or uniform weak convergence; we then review robustness properties on the space of kernels, and finally we establish compactness conditions on the space of kernels. Building on this regularity analysis, we then present two data-driven identifiability results; the first one being Bayesian and the second one empirical. Our conditions for the Bayesian setting are significantly more relaxed compared with prior work which considered either finite or parametric models, though we do not obtain a rate of convergence. Our analysis is asymptotic and builds on measurability in terms of the tail $σ$-field of the available information. Identifiability results are then used to design near-optimal adaptive control policies which alternate between periods of exploration, where the controller acts according to a policy which is conducive to the identification of the true kernel, and periods of exploitation where the controller's information on the kernel is utilized. We will establish that such policies are near optimal. In summary, our contribution is with regard to the general standard Borel setup where there is no apriori parametric representation.

math.OC↗

Differentiable Nonlinear Model Predictive Control

The efficient computation of parametric solution sensitivities is a key challenge in the integration of learning-enhanced methods with nonlinear model predictive control, as their availability is crucial for many learning algorithms. This paper discusses the computation of solution sensitivities of general nonlinear programs using the implicit function theorem and smoothed optimality conditions treated in interior-point methods (IPM). We introduce sequential barrier quadratic programming (SBQP), which generalizes SQP with an IPM quadratic programming (QP) solver by allowing the barrier parameter to approach a prescribed nonnegative target value, recovering classical SQP when this target is zero. Previous works are limited to convex or unconstrained formulations, or lack an implementation for efficient sensitivity evaluation. The publication is accompanied by an efficient open-source implementation within the `acados` framework, providing both forward and adjoint sensitivities for general optimal control problems, achieving speedups exceeding 3x over the state-of-the-art solvers `mpc.pytorch` and `cvxpygen`.

math.OC↗