arXiv ScienceSearch

arXiv subjects

Morgan Jones

Publications and source records attributed to Morgan Jones.

At least 19 recordsLinked to original sources

Lifting-Free Quadratic Sum-Of-Squares Programming

Quadratic Sum-Of-Squares (QSOS) optimization problems appear in system identification and machine learning, but standard Schur-complement and second-order cone liftings enlarge conic dimensions and create computational bottlenecks for interior-point methods. This paper introduces a lifting-free regularization that preserves the original conic structure by adding a norm penalty to SOS variables, yielding closed-form primal updates and an unconstrained, concave dual with Lipschitz-continuous gradient. Accelerated first-order methods efficiently maximize this dual, and convergence analysis shows non-asymptotic recovery of the solution. Numerical experiments on constrained regression problems show the proposed method can be 40\% faster than existing solvers such as SCS and handle larger problems than MOSEK, with memory scaling only in the number of equality constraints.

math.OC

Quantum Fidelity on Krein and S-spaces

The notion of fidelity for quantum states is a measure of how much two states overlap. In the matrix formalism of quantum mechanics, states are represented by density operators, i.e., positive semi-definite matrices with trace equal to 1 in a complex Euclidean space $M_n(\mathbb{C})$. Felipe-Sosa and Felipe (2022) introduced the notion of quantum states on certain Krein spaces with indefinite metric induced by a fundamental symmetry $J$, calling these $J$-states. We define an analogous notion of measurement for $J$-states to the regular quantum theory and use it to show that a notion of fidelity holds in the Krein setting. We also show that an analogous result to the Fuchs-Caves measurement holds in this setting. Following the developments of Bag, Rohilla, and Trivedi (2024), we then extend this definition of fidelity to $U$-quantum states on $S$-spaces. We demonstrate that the analogous geometric motivation holds in the Krein and $S$-space setting, as holds for quantum fidelity and geometric means of operators.

quant-ph

Feedback Linearisation with State Constraints

Feedback Linearisation (FBL) is a widely used technique that applies feedback laws to transform input-affine nonlinear control systems into linear control systems, allowing for the use of linear controller design methods such as pole placement. However, for problems with state constraints, controlling the linear system induced by FBL can be more challenging than controlling the original system. This is because simple state constraints in the original nonlinear system become complex nonlinear constraints in the FBL induced linearised system, thereby diminishing the advantages of linearisation. To avoid increasing the complexity of state constraints under FBL, this paper introduces a method to first augment system dynamics to capture state constraints before applying FBL. We show that our proposed augmentation method leads to ill-defined relative degrees at state constraint boundaries. However, we show that ill-defined relative degrees can be overcome by using a switching FBL controller. Numerical experiments illustrate the capabilities of this method for handling state constraints within the FBL framework.

eess.SY

Bounding the Error of Value Functions in Sobolev Norm Yields Bounds on Suboptimality of Controller Performance

Optimal feedback controllers for nonlinear systems can be derived by solving the Hamilton-Jacobi-Bellman (HJB) equation. However, because the HJB equation is a nonlinear partial differential equation, numerical methods typically provide only approximate solutions. While numerical error bounds on approximate HJB solutions are often available, these bounds do not necessarily translate into guarantees on the suboptimality of the resulting controllers. In this paper, we establish that the suboptimality of the resulting controller is bounded by the $L^\infty$ norm of the HJB residual, which is, in turn, bounded by numerical error in the value function as measured in the Sobolev $W^{1,\infty}$ norm. This implies that convergence of value functions in $W^{1,\infty}$ result in controllers that yield a cost that is arbitrarily close to the true minimum. In contrast, we demonstrate that such guarantees do not hold when the value function error is measured in weaker norms, such as the Sobolev $W^{1,p}$ norm for finite $p$.}These results apply to systems governed by Lipschitz continuous dynamics over a finite time horizon with compact input space.

math.OC

Approximate Projections onto the Positive Semidefinite Cone Using Randomization

This paper presents two algorithms that compute approximate Positive Semidefinite (PSD) projections of real symmetric matrices using Randomized Numerical Linear Algebra (RNLA). Classical PSD projection of an $n\times n$ matrix relies on a deterministic eigen-decomposition with computation that scales as $\mathcal{O}(n^3)$. Our approach leverages RNLA to construct low-rank matrix approximations before projection, significantly reducing the required numerical resources to $\mathcal{O}(k n^2)$, for some user defined fixed parameter $k$. The first algorithm utilizes random sampling to generate a low-rank approximation, followed by a standard eigen-decomposition on this smaller matrix. The second algorithm enhances this process by introducing a scaling approach that aligns the leading-order singular values with the positive eigenvalues, biasing the low-rank approximation to focus on capturing the essential information about the positive eigenvalues for PSD projection. Both methods offer a trade-off between accuracy and computational speed, supported by probabilistic error bounds. Numerical experiments on large-scale matrices ( $n\approx 20K$) demonstrate that the proposed randomized algorithms effectively approximate PSD projections.

math.OC

Model Predictive Bang-Bang Controller Synthesis via Approximate Value Functions

In this paper, we propose a novel method for addressing Optimal Control Problems (OCPs) with input-affine dynamics and cost functions. This approach adopts a Model Predictive Control (MPC) strategy, wherein a controller is synthesized to handle an approximated OCP within a finite time horizon. Upon reaching this horizon, the controller is re-calibrated to tackle another approximation of the OCP, with the approximation updated based on the final state and time information. To tackle each OCP instance, all non-polynomial terms are Taylor-expanded about the current time and state and the resulting Hamilton-Jacobi-Bellman (HJB) PDE is solved via Sum-of-Squares (SOS) programming, providing us with an approximate polynomial value function that can be used to synthesize a bang-bang controller.

math.OC

Learning Polynomial Representations of Physical Objects with Application to Certifying Correct Packing Configurations

This paper introduces a novel approach for learning polynomial representations of physical objects. Given a point cloud data set associated with a physical object, we solve a one-class classification problem to bound the data points by a polynomial sublevel set while harnessing Sum-of-Squares (SOS) programming to enforce prior shape knowledge constraints. By representing objects as polynomial sublevel sets we further show it is possible to construct a secondary SOS program to certify whether objects are packed correctly, that is object boundaries do not overlap and are inside some container set. While not employing reinforcement learning (RL) in this work, our proposed secondary SOS program does provide a potential surrogate reward function for RL algorithms, autonomously rewarding agents that propose object rotations and translations that correctly pack objects within a given container set.

math.OC

Sparse Identification of Nonlinear Dynamics with Side Information (SINDy-SI)

Modern societies have an abundance of data yet good system models are rare. Unfortunately, many of the current system identification and machine learning techniques fail to generalize outside of the training set, producing models that violate basic physical laws. This work proposes a novel method for the Sparse Identification of Nonlinear Dynamics with Side Information (SINDy-SI). SINDy-SI is an iterative method that uses Sum-of-Squares (SOS) programming to learn optimally fitted models while guaranteeing that the learned model satisfies side information, such as symmetry's and physical laws. Guided by the principle of Occam's razor, that the simplest or most regularized best fitted model is typically the superior choice, during each iteration SINDy-SI prunes the basis functions associated with small coefficients, yielding a sparse dynamical model upon termination. Through several numerical experiments we will show how the combination of side information constraints and sparse polynomial representation cultivates dynamical models that obey known physical laws while displaying impressive generalized performance beyond the training set.

eess.SY

Sublevel Set Approximation in The Hausdorff and Volume Metric with Application to Path Planning and Obstacle Avoidance

Under what circumstances does the ``closeness" of two functions imply the ``closeness" of their respective sublevel sets? In this paper, we answer this question by showing that if a sequence of functions converges strictly from above/below to a function, $V$, in the $L^\infty$ (or $L^1$) norm then these functions yield a sequence sublevel sets that converge to the sublevel set of $V$ with respect to the Hausdorff metric (or volume metric). Based on these theoretical results we propose Sum-of-Squares (SOS) numerical schemes for the optimal outer/inner polynomial sublevel set approximation of various sets, including intersections and unions of semialgebraic sets, Minkowski sums, Pontryagin differences and discrete points. We present several numerical examples demonstrating the usefulness of our proposed algorithm including approximating sets of discrete points to solve machine learning one-class classification problems and approximating Minkowski sums to construct C-spaces for computing optimal collision-free paths for Dubin's car.

math.OC

Existence of Partially Quadratic Lyapunov Functions That Can Certify The Local Asymptotic Stability of Nonlinear Systems

This paper proposes a method for certifying the local asymptotic stability of a given nonlinear Ordinary Differential Equation (ODE) by using Sum-of-Squares (SOS) programming to search for a partially quadratic Lyapunov Function (LF). The proposed method is particularly well suited to the stability analysis of ODEs with high dimensional state spaces. This is due to the fact that partially quadratic LFs are parametrized by fewer decision variables when compared with general SOS LFs. The main contribution of this paper is using the Center Manifold Theorem to show that partially quadratic LFs that certify the local asymptotic stability of a given ODE exist under certain conditions.

math.OC

Combining Trajectory Data with Analytical Lyapunov Functions for Improved Region of Attraction Estimation

The increasing uptake of inverter based resources (IBRs) has resulted in many new challenges for power system operators around the world. The high level of complexity of IBR generators makes accurate classical model-based stability analysis a difficult task. This paper proposes a novel methodology for solving the problem of estimating the Region of Attraction (ROA) of a nonlinear system by combining classical model based methods with modern data driven methods. Our method yields certifiable inner approximations of the ROA, typical to that of model based methods, but also harnesses trajectory data to yield an improved accurate ROA estimation. The method is carried out by using analytical Lyapunov functions, such as energy functions, in combination with data that is used to fit a converse Lyapunov function. Our methodology is independent of the function fitting method used. In this work, for implementation purposes, we use Bernstein polynomials to function fit. Several numerical examples of ROA estimation are provided, including the Single Machine Infinite Bus (SMIB) system, a three machine system and the Van-der-Pol system.

eess.SY

A Converse Sum of Squares Lyapunov Function for Outer Approximation of Minimal Attractor Sets of Nonlinear Systems

Many dynamical systems described by nonlinear ODEs are unstable. Their associated solutions do not converge towards an equilibrium point, but rather converge towards some invariant subset of the state space called an attractor set. For a given ODE, in general, the existence, shape and structure of the attractor sets of the ODE are unknown. Fortunately, the sublevel sets of Lyapunov functions can provide bounds on the attractor sets of ODEs. In this paper we propose a new Lyapunov characterization of attractor sets that is well suited to the problem of finding the minimal attractor set. We show our Lyapunov characterization is non-conservative even when restricted to Sum-of-Squares (SOS) Lyapunov functions. Given these results, we propose a SOS programming problem based on determinant maximization that yields an SOS Lyapunov function whose 1-sublevel set has minimal volume, is an attractor set itself, and provides an optimal outer approximation of the minimal attractor set of the ODE. Several numerical examples are presented including the Lorenz attractor and Van-der-Pol oscillator.

math.DS

Converse Lyapunov Functions and Converging Inner Approximations to Maximal Regions of Attraction of Nonlinear Systems

This paper considers the problem of approximating the "maximal" region of attraction (the set that contains all asymptotically stable sets) of any given set of locally exponentially stable nonlinear Ordinary Differential Equations (ODEs) with a sufficiently smooth vector field. Given a locally exponential stable ODE with a differentiable vector field, we show that there exists a globally Lipschitz continuous converse Lyapunov function whose 1-sublevel set is equal to the maximal region of attraction of the ODE. We then propose a sequence of d-degree Sum-of-Squares (SOS) programming problems that yields a sequence of polynomials that converges to our proposed converse Lyapunov function uniformly from above in the L1 norm. We show that each member of the sequence of 1-sublevel sets of the polynomial solutions to our proposed sequence of SOS programming problems are certifiably contained inside the maximal region of attraction of the ODE, and moreover, we show that this sequence of sublevel sets converges to the maximal region of attraction of the ODE with respect to the volume metric. We provide numerical examples of estimations of the maximal region of attraction for the Van der Pol oscillator and a three dimensional servomechanism.

math.OC

Polynomial Approximation of Value Functions and Nonlinear Controller Design with Performance Bounds

For any suitable Optimal Control Problem (OCP) there exists a value function, defined as the unique viscosity solution to the Hamilton-Jacobi-Bellman (HJB) Partial-Differential-Equation (PDE), and which can be used to design an optimal feedback controller for the given OCP. In this paper, we approximately solve the HJB-PDE by proposing a sequence of Sum-Of-Squares (SOS) problems, each of which yields a polynomial subsolution to the HJB-PDE. We show that the resulting sequence of polynomial sub-solutions converges to the value function of the OCP in the L1 norm. Furthermore, for each polynomial sub-solution in this sequence, we show that the associated sequence of sublevel sets converge to the sublevel set of the value function of the OCP in the volume metric. Next, for any approximate value function, obtained from an SOS program or any other method (e.g. discretization), we construct an associated feedback controller, and show that sub-optimality of this controller as applied to the OCP is bounded by the distance between the approximate and true value function of the OCP in the Sobolev norm. Finally, we demonstrate numerically that by solving our proposed SOS problem we are able to accurately approximate value functions, design controllers and estimate reachable sets.

math.OC

A Generalization of Bellman's Equation with Application to Path Planning, Obstacle Avoidance and Invariant Set Estimation

The standard Dynamic Programming (DP) formulation can be used to solve Multi-Stage Optimization Problems (MSOP's) with additively separable objective functions. In this paper we consider a larger class of MSOP's with monotonically backward separable objective functions; additively separable functions being a special case of monotonically backward separable functions. We propose a necessary and sufficient condition, utilizing a generalization of Bellman's equation, for a solution of a MSOP, with a monotonically backward separable cost function, to be optimal. Moreover, we show that this proposed condition can be used to efficiently compute optimal solutions for two important MSOP's; the optimal path for Dubin's car with obstacle avoidance, and the maximal invariant set for discrete time systems.

math.OC

Relaxing The Hamilton Jacobi Bellman Equation To Construct Inner And Outer Bounds On Reachable Sets

We consider the problem of overbounding and underbounding both the backward and forward reachable set for a given polynomial vector field, nonlinear in both state and input, with a given semialgebriac set of initial conditions and with inputs constrained pointwise to lie in a semialgebraic set. Specifically, we represent the forward reachable set using the value function which gives the optimal cost to go of an optimal control problems and if smooth satisfies the Hamilton-Jacobi- Bellman PDE. We then show that there exist polynomial upper and lower bounds to this value function and furthermore, these polynomial sub-value and super-value functions provide provable upper and lower bounds to the forward reachable set. Finally, by minimizing the distance between these sub-value and super-value functions in the L1-norm, we are able to construct inner and outer bounds for the reachable set and show numerically on several examples that for relatively small degree, the Hausdorff distance between these bounds is negligible.

math.OC

Using SOS and Sublevel Set Volume Minimization for Estimation of Forward Reachable Sets

In this paper we propose a convex Sum-of-Squares optimization problem for finding outer approximations of forward reachable sets for nonlinear uncertain Ordinary Differential Equations (ODE's) with either (or both) L2 or point-wise bounded input disturbances. To make our approximations tight we seek to minimize the volume of our approximation set. Our approach to volume minimization is based on the use of a convex determinant-like objective function. We provide several numerical examples including the Lorenz system and the Van der Pol oscillator.

math.DS

Extensions of the Dynamic Programming Framework: Battery Scheduling, Demand Charges, and Renewable Integration

We consider a general class of Dynamic Programming (DP) problems with non-separable objective functions. We show that for any problem in this class, there exists an augmented-state DP problem which satisfies the Principle of Optimality and the solutions to which yield solutions to the original problem. Furthermore, we identify a subclass of DP problems with Naturally Forward Separable (NFS) objective functions for which this state-augmentation scheme is tractable. We extend this framework to stochastic DP problems, proposing a suitable definition of the Principle of Optimality. We then apply the resulting algorithms to the problem of optimal battery scheduling with demand charges using a data-based stochastic model for electricity usage and solar generation by the consumer.

math.OC