arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2408.06884

Tikhonov regularization of second-order plus first-order primal-dual dynamical systems for separable convex optimization

Xiangkai Sun·Lijuan Zheng·Kok Lay Teo
View original source ↗Read source document ↗Export metadata ↓

Abstract

This paper deals with a Tikhonov regularized second-order plus first-order primal-dual dynamical system with time scaling for separable convex optimization problems with linear equality constraints. This system consists of two second-order ordinary differential equations for the primal variables and one first-order ordinary differential equation for the dual variable.By utilizing the Lyapunov analysis approach, we obtain the convergence properties of the primal-dual gap, the objective function error, the feasibility measure and the gradient norm of the objective function along the trajectory. We also establish the strong convergence of the primal trajectory generated by the dynamical system towards the minimal norm solution of the separable convex optimization problem. Furthermore, we give numerical experiments to illustrate the theoretical results, showing that our dynamical system performs better than those in the literature in terms of convergence rates.

Explore related subjects

math.OC

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Xiangkai Sun, Lijuan Zheng, Kok Lay Teo. 2025-03-14. Tikhonov regularization of second-order plus first-order primal-dual dynamical systems for separable convex optimization. https://doi.org/10.1007/s10957-025-02766-6

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Learning-Based Surrogate Method for Stochastic Optimization under Decision-Dependent Uncertainty with Adaptive Random Designs

We study stochastic programs in which the latent decision-dependent uncertainty is described via a nonparametric regression model. The major challenge is that, without convexity assumptions on either the cost function or the regression model, the resulting objective is both nonconvex and nonsmooth, and its first-order information is unavailable due to the unknown decision-dependent distribution. To address this issue, we construct a learning-based surrogate model that integrates simulation and statistical learning by embedding Jacobian estimates of the regression function, which are updated iteratively and interactively during the optimization procedure. We develop an adaptive random design that concentrates design points around the current iterate for Jacobian estimation and we show that the mean squared error of Jacobian estimates achieves a dimension-independent convergence rate. Building on this, we propose the learning-based stochastic prox-linear (L-SPL) algorithm with adaptive random design and establish its nonasymptotic convergence rates under various parameter settings. Numerical results demonstrate that L-SPL algorithm significantly improves sample efficiency and achieves substantially lower objective values compared to the state-of-the-art methods. More broadly, our method implies that the statistical design in an iterative learning-based optimization algorithm can be novelly tailored to the local information of the optimization procedure to sharpen estimates and enhance the convergence performance and sample efficiency of the resulting algorithm.

math.OC↗
arXiv2026

Delay and Memory-Type Null Controllability for Heat Equations in Finite Dimensions

We study null controllability for linear heat-type systems in finite dimensions that incorporate both memory and time-delay effects. A strengthened notion of controllability, referred to as delay and memory-type null controllability, is introduced, which requires the state, the memory functional, and the delayed history to vanish at the terminal time. Using a duality approach, we establish an augmented observability inequality for the adjoint system and show its equivalence to controllability. In the finite-dimensional setting, this leads to sharp necessary and sufficient algebraic rank conditions extending the classical Kalman criterion to systems with memory and delay.

math.OC↗
arXiv2026

Iterative graph lifting for automatic design of path-complete stability certificates

Stability of switched linear systems under arbitrary switching is a fundamental problem in control theory, closely related to the joint spectral radius (JSR), which characterizes the worst-case growth rate of system trajectories. In this paper, we contribute to the path-complete approach for approximating the JSR. This framework constructs algebraic stability certificates using labeled directed graphs, known as path-complete graphs. These certificates can be computed via an associated optimization problem. We propose an iterative algorithm that refines path-complete graphs in an efficient and parsimonious manner. The algorithm relies on a graph-theoretic analysis of the optimality conditions of the underlying optimization problem. In particular, we derive a sufficient condition under which the exact JSR is attained by a given path-complete graph. When this condition is not satisfied, we identify bottleneck nodes by analyzing the graph induced by the active constraints. We then use this information to refine the path-complete graph via local graph lifting (node splitting), and repeat the procedure. Numerical experiments demonstrate the effectiveness and scalability of the proposed approach, outperforming state-of-the-art methods on all challenging instances tested.

math.OC↗