arXiv Science⌕ Search

SEARCH · arXiv Science

Results for “math.OC”

Search indexed arXiv papers on artificial intelligence, large language models, computer vision and robotics. Read source abstracts and follow links to arXiv.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

601 records · Page 2Linked to original sources
arXiv2026

Subspace Levenberg Marquardt Algorithms in Training Neural Networks

The Levenberg-Marquardt (LM) algorithm is a well-known second-order method for rapid convergence and strong robustness when training small- to medium-sized neural networks (NNs). However, its computational and memory costs increase significantly as the number of parameters in an NN grows. To address this limitation, subspace methods have been proposed, such as the Krylov subspace LM (KSLM) and the hybrid subspace LM (HSLM), making second-order algorithms more efficient. In this work, we evaluate the subspace Levenberg-Marquardt algorithms for regression and classification tasks in neural networks. We compare the performance of subspace LM variants with the classical LM method, as well as other popular first-order algorithms, such as stochastic gradient descent (SGD) and Adam.

cs.LG↗
arXiv2026

On two proofs of $d^2$ mixing of weighted Dikin walks

We study the mixing time of weighted Dikin walks for sampling from exponential distributions on polytopes and truncated positive-semidefinite (PSD) cones. Our first result gives a general total-variation mixing bound under strong self-concordance, $\barν$-symmetry, and mixed-trace regularity on the local metric. The key idea is to control the Metropolis--Hastings acceptance probability on a high-probability region rather than at every point. Applying this framework to the Lee--Sidford, Lewis-weight, and John metrics yields an $\widetilde O(d^2)$ mixing bound for sampling from polytopes, while applying it to a hybrid barrier yields an $\widetilde O(d^4)$ mixing bound for sampling from truncated PSD cones. Our second result establishes stronger $χ^2$-divergence guarantees and pointwise acceptance control using a new fourth-order bootstrap condition. For a suitably scaled Lee--Sidford metric, this yields an $\widetilde O(d^2)$ mixing bound in $χ^2$-divergence, improving on the previous $\widetilde O(d^{9/4})$ bound.

cs.DS↗
arXiv2026

The Indefinite Summation Problem for the Laurent Ring

This article solves the Indefinite Summation Problem (ISP) for the difference ring $(A, α)$, where $A$ is the Laurent ring of shift operators on the lattice $\Z^n$, and $α$ is any ring automorphism of $A$ of finite order. The solution translates to a finite procedure involving a matrix multiplication, where the size of the matrix can be estimated. It follows that the arithmetic complexity of the solution can also be determined. These results extend to a solution of the ISP for the ring of functions on $\Z^n$, on which $α$ acts by duality. The article points out that the solution to the ISP amounts to calculating the group cohomologies $H^i([α], A), i = 0, 1$, where $[α]$ is the cyclic group generated by $α$.

cs.SC↗
arXiv2026

Operator-Theoretic Stability and Observer Synthesis for Parameter-Dependent Vlasov--Maxwell Dynamics

An operator--theoretic formulation is developed for the synthesis of parameter-dependent controllers and observers for the Vlasov--Maxwell system. The linearized dynamics are modeled as a non-autonomous evolution system whose generators depend on measurable plasma quantities. Well-posedness of the associated evolution family is established together with uniform growth bounds. Parameter-dependent Lyapunov operators yield operator differential LMIs ensuring uniform exponential stability and observer convergence. An $H_\infty$ extension provides disturbance attenuation conditions consistent with the intrinsic energy structure of the coupled Vlasov--Maxwell equations. Galerkin projections lead to finite-dimensional LMIs consistent with the operator inequalities, enabling reliable numerical synthesis while preserving the analytical structure of the original model. Numerical results on a reduced Vlasov--Maxwell benchmark confirm the predicted convergence properties.

eess.SY↗
arXiv2026

Successive design of backstepping observers for parabolic PDE-ODE systems and its duality to state feedback stabilization

The paper introduces a successive backstepping observer design for strictly feedforward parabolic PDE-ODE systems, in which the coupling structure determines the order of error stabilization and the corresponding transformations. First, a transformation based on a virtual measurement stabilizes the ODE observer error subsystem, which is most distal from the measurement, while decoupling it from the PDE error state. Second, a Volterra integral transformation is employed to stabilize the PDE error subsystem and to map the overall error dynamics into a cascade of exponentially stable ODE and PDE subsystems. The design is shown to be dual to a recently proposed multi-step state feedback design for parabolic PDE-ODE systems in strict feedback form, thus explaining the structure of the presented observer design.

math.OC↗
arXiv2026

Constrained Parameter Update Law for Adaptive Control

In this paper, constrained parameter update laws for adaptive control are developed using barrier constraints. An interpretation of the parameter update law from a constrained optimization problem, in which a regularized Barrier saddle function is formulated to incorporate parameter constraints using inverse and logarithmic barrier functions from interior-point methods. The resulting constrained update law is integrated with an adaptive trajectory tracking controller, enabling online learning of the unknown system model parameters. Forward invariance of the parameter estimate is established and Lyapunov stability of the closed-loop system with the constrained parameter update law is derived. The effectiveness of the proposed constrained adaptive control law is demonstrated through simulations, which validate its ability to maintain parameter estimates within prescribed bounds while ensuring convergence to the true parameter values and achieving steady state tracking performance.

math.OC↗
arXiv2026

Separable Nonnegative Matrix Factorization Using Powered Ratio-of-Norms Regularization

Separable nonnegative matrix factorization (SNMF) has been widely used for low-rank representation and clustering of nonnegative data, owing to its ability to produce part-based and interpretable decompositions. In particular, SNMF is closely related to graph clustering and community detection. To enhance sparsity and identifiability of the learned factors, we propose an $\ell_1^p/\ell_2$-regularized SNMF model based on a powered ratio-of-norms regularizer. The resulting formulation is nonconvex and nonsmooth, which poses significant challenges for optimization. To address this, we develop efficient algorithms based on the difference-of-convex function algorithm (DCA) and the alternating direction method of multipliers (ADMM). The proposed methods decompose the original problem into tractable subproblems, leveraging closed-form proximal operators associated with the powered norm terms. We establish descent and limiting criticality properties for the DCA scheme and convergence under standard assumptions for the ADMM scheme. Extensive numerical experiments on synthetic datasets and hand gesture classification tasks demonstrate that the proposed approach achieves competitive or improved performance in anchor identification and classification accuracy compared with existing SNMF methods, while maintaining competitive computational efficiency.

math.NA↗
arXiv2023

Local minima in quantum systems

Finding ground states of quantum many-body systems is known to be hard for both classical and quantum computers. As a result, when Nature cools a quantum system in a low-temperature thermal bath, the ground state cannot always be found efficiently. Instead, Nature finds a local minimum of the energy. In this work, we study the problem of finding local minima in quantum systems under thermal perturbations. While local minima are much easier to find than ground states, we show that finding a local minimum is computationally hard for classical computers, even when the task is to output a single-qubit observable at any local minimum. In contrast, we prove that a quantum computer can always find a local minimum efficiently using a thermal gradient descent algorithm that mimics the cooling process in Nature. To establish the classical hardness of finding local minima, we consider a family of two-dimensional Hamiltonians such that any problem solvable by polynomial-time quantum algorithms can be reduced to finding ground states of these Hamiltonians. We prove that for such Hamiltonians, all local minima are global minima. Therefore, assuming quantum computation is more powerful than classical computation, finding local minima is classically hard and quantumly easy.

quant-ph↗
arXiv2026

SOVER: Formal Certification of Optimization Reformulations via LLM-Assisted SMT Verification

Large Language Models (LLMs) have shown remarkable promise in translating and reformulating complex mathematical optimization problems across modeling languages. However, validating such transformations through empirical solver executions alone is unreliable, as solver outcomes may be affected by local minima, structural timeouts, numerical artifacts, and subtle semantic divergence between formulations. We introduce SOVER, an LLM-assisted SMT framework that separates semantic mapping from formal certification: Z3 checks domain cross-feasibility and global objective-order preservation for mixed-integer linear formulations, while dReal provides tolerance-aware feasibility/range and $ε$-argmin checks for continuous nonlinear formulations. We also introduce NLEquiv-150, a public benchmark of 100 equivalent and 50 deliberately hard non-equivalent nonlinear reformulation pairs. With LLM-extracted mappings, SOVER classifies 149/150 pairs (99.33%) correctly, including all 50 hard negatives; the sole error is an incomplete mapping extraction.

cs.AI↗
arXiv2026

Generalized Semi-Infinite Programming for Robust Optimal Control with Decision-Dependent Uncertainty

Generalized semi-infinite programs (GSIPs) arise in robust optimal control whenever the admissible uncertainty depends on the state or controls. Existing GSIP methods either impose restrictive structural assumptions or require global optimization that scales poorly to control problems. We present a general framework that reformulates any GSIP with mild regularity as an existence-constrained semi-infinite program, smoothing its disjunctive feasibility condition into differentiable existence constraints over a fixed index superset. The resulting program is solved by established adaptive discretization (cutting-plane) methods using only off-the-shelf nonlinear-programming solvers, and converges under standard assumptions. Treating the state trajectory as part of the uncertainty extends the framework to robust nonlinear optimal control with state-dependent uncertainty. We demonstrate it on a nonconvex benchmark GSIP and a satellite de-tumbling problem with dynamically varying inertia.

math.OC↗
arXiv2026

Finite Sample Identification of Analytic Nonlinear Systems

This paper studies the identification of linearly parameterized nonlinear (LPN) systems. Although LPN systems share the same linear parameterization structure as linear systems, they are more challenging to identify. In particular, previous work has shown, through a counterexample based on a piecewise-affine system, that non-active exploration is generally insufficient for LPN system identification. In this paper, we consider LPN systems with real-analytic feature functions. We show that non-active exploration is sufficient for the identification of this class of systems by establishing non-asymptotic convergence rates of least-squares estimation and set-membership estimation. In addition, we provide counterexamples to show that non-active exploration may not be sufficient for system identification for non-real-analytic systems, even if those systems are infinitely differentiable. We present numerical experiments to further support and validate our theoretical results.

eess.SY↗
arXiv2026

Feasible approximation of matching equilibria for large-scale matching for teams problems

We propose a numerical algorithm for computing feasible and approximately optimal solutions of the matching for teams problem. Specifically, we introduce the notion of approximate matching equilibrium as a feasible approximation of a matching equilibrium with relaxed rationality, and we show that a true equilibrium is recovered in the limit of a sequence of approximate matching equilibria with sub-optimality approaching 0. In our approximation scheme, we parametrize the so-called transfer functions, and we show that tackling the resulting parametric primal and dual optimization problems yields two approximate matching equilibria as well as provable and computable lower and upper bounds for the optimal social welfare. Under a flexible Euclidean setting, we show that the approximation error of our scheme can be controlled to be arbitrarily close to 0, we derive an explicit computational complexity bound, and we develop an algorithm for computing approximate matching equilibria that is efficient for large-scale problems involving a large number of agent populations. We study three problems in our numerical experiments: a retail business problem, the Wasserstein barycenter problem, and a large-scale problem involving up to 1000 agent populations. We show that the proposed algorithm can produce nearly optimal approximate matching equilibria to provide quantitative managerial insights for policymakers, and that the computed sub-optimality estimates are much less conservative than theoretical estimates.

math.OC↗
arXiv2026

Linear Coding of LTI Sources Over Vector Gaussian Channels: A Majorization Approach

We study the design of linear time-invariant (LTI) encoder-decoder pairs for transmitting the state of a discrete-time LTI vector source over power-constrained parallel Gaussian channels with feedback. Two types of power constraints are considered. Under individual subchannel power constraints, a necessary and sufficient condition for designing an encoder-decoder pair that achieves bounded estimation error covariance (EEC) is established via two coupled majorization inequalities involving the subchannel signal-to-noise ratios and the antistable poles of the source. Under total channel power constraint, we derive the minimum total power required for a feasible encoder-decoder design by exploiting partial-order progamming under majorization order. An analytical optimal power allocation is obtained for the case of equal noise variances, which admits a water-filling interpretation; for general noise case, a sequential water-filling algorithm is developed. Our results reveal that the difficulty of transmitting a discrete-time LTI source via LTI coding is governed not only by its topological entropy, but also by the evenness of the log-magnitudes of its antistable poles. The design methods for feasible encoder-decoder pairs are also provided.

cs.IT↗
arXiv2026

Nechvile-Transformed Spacecraft Dynamics and Propellant Computation in the 3-Body Problem

The uncontrolled equations of motion in the Nechvile frame for the restricted three-body problem have been well-known since at least the 1960s. It would seem that adding an external force to these equations is quite trivial: simply add an external force per mass term to the acceleration equations. Here we show that the last statement is not true. In fact, we show that the additive generic external force must be multiplied by the inverse of $(1 + e \cosθ)^3$ where $e$ is the relative eccentricity of the primaries and $θ$ is the true anomaly of the rotating frame located at the barycenter. Furthermore, when this result is combined with the mass flow rate equation, it generates several surprising results due to the mismatch between the resulting quadratic term and the cubic term in the equations of motion. This leads to a corresponding modification of the rocket equation itself. A Birkhoff-theoretic solution to an illustrative cislunar space mission problem shows propellent savings of 80% with the use of the correct cost functional. The popular quadratic cost utilizes more than $2X$ the minimum propellant consumption.

math.OC↗
arXiv2017

Yield Trajectory Tracking for Hyperbolic Age-Structured Population Systems

For population systems modeled by age-structured hyperbolic partial differential equations (PDEs) that are bilinear in the input and evolve with a positive-valued infinite-dimensional state, global stabilization of constant yield set points was achieved in prior work. Seasonal demands in biotechnological production processes give rise to time-varying yield references. For the proposed control objective aiming at a global attractivity of desired yield trajectories, multiple non-standard features have to be considered: a non-local boundary condition, a PDE state restricted to the positive orthant of the function space and arbitrary restrictive but physically meaningful input constraints. Moreover, we provide Control Lyapunov Functionals ensuring an exponentially fast attraction of adequate reference trajectories. To achieve this goal, we make use of the relation between first-order hyperbolic PDEs and integral delay equations leading to a decoupling of the input-dependent dynamics and the infinite-dimensional internal one. Furthermore, the dynamic control structure does not necessitate exact knowledge of the model parameters or online measurements of the age-profile. With a Galerkin-based numerical simulation scheme using the key ideas of the Karhunen-Loève-decomposition, we demonstrate the controller's performance.

math.OC↗
arXiv2026

On the invariance of risk-sensitive LQR gain under input randomization

This paper shows that the optimal gain of the risk-sensitive linear quadratic regulator (LQR) problem is invariant under input randomization, i.e., when the controller deliberately injects noise into the nominal control input. This appears counterintuitive at first glance because certainty equivalence does not hold for risk-sensitive LQR and input randomization inflates the effective process noise. Nonetheless, the gain is preserved because the input noise enters not only the system dynamics but also the cost functional, and its total effect on the gain eventually vanishes. Consequently, the optimal gain and its associated Riccati recursion need not be recomputed, and the increment in the optimal cost can be readily evaluated in closed form. This result facilitates the use of risk-sensitive LQR in applications that employ input randomization for privacy or exploration, such as watermarking for replay attack detection, differential privacy, and path integral control.

math.OC↗
arXiv2026

Independent Reinforcement Learning in Discounted Markov Games

In this work, we study radically uncoupled learning in discounted general-sum Markov games. Assuming ``$\mathsf{ETH}$ for $\mathsf{PPAD}$", we show that, for every fixed discount factor, there is no polynomial-time algorithm for computing inverse-polynomially accurate coarse correlated equilibria in discounted general-sum Markov games when players learn independently in decentralized settings. Complementing this hardness result, we provide what appears to be the first \emph{radically uncoupled} algorithm with sub-exponential convergence guarantees to coarse correlated equilibria in discounted general-sum Markov games without imposing any structural restrictions on the game. Our algorithm is a \emph{layered} variant of optimistic mirror descent with an increasing step-size schedule tailored to the multi-agent setting. Finally, we develop both full-feedback and partial feedback versions of the aforementioned algorithm and establish sub-exponential convergence guarantees for each case.

cs.GT↗
arXiv2026

Uniform a priori bounds and error analysis for the Adam stochastic gradient descent optimization method

The adaptive moment estimation (Adam) optimizer proposed by Kingma & Ba (2014) is presumably the most popular stochastic gradient descent (SGD) optimization method for the training of deep neural networks (DNNs) in artificial intelligence (AI) systems. Despite its groundbreaking success in the training of AI systems, it still remains an open research problem to provide a complete error analysis of Adam, not only for optimizing DNNs but even when applied to strongly convex stochastic optimization problems (SOPs). Previous error analysis results for strongly convex SOPs in the literature provide conditional convergence analyses that rely on the assumption that Adam does not diverge to infinity but remains uniformly bounded. It is the key contribution of this work to establish uniform a priori bounds for Adam and, thereby, to provide -- for the first time -- an unconditional error analysis for Adam for a large class of strongly convex SOPs.

cs.LG↗