arXiv subjects

Manuel Schaller

Publications and source records attributed to Manuel Schaller.

At least 55 records · Page 3Linked to original sources

arXiv2024

Port-Hamiltonian structures in infinite-dimensional optimal control: Primal-Dual gradient method and control-by-interconnection

In this note, we consider port-Hamiltonian structures in numerical optimal control of ordinary differential equations. By introducing a novel class of nonlinear monotone port-Hamiltonian (pH) systems, we show that the primal-dual gradient method may be viewed as an infinite-dimensional nonlinear pH system. The monotonicity and the particular block structure arising in the optimality system is used to prove exponential stability of the dynamics towards its equilibrium, which is a critical point of the first-order optimality conditions. Leveraging the port-based modeling, we propose an optimization-based controller in a suboptimal receding horizon control fashion. To this end, the primal-dual gradient based optimizer-dynamics is coupled to a pH plant dynamics in a power-preserving manner. We show that the resulting model is again monotone pH system and prove that the closed-loop exhibits local exponential convergence towards the equilibrium.

math.OC↗

arXiv2024

Equivariance and partial observations in Koopman operator theory for partial differential equations

The Koopman operator has become an essential tool for data-driven analysis, prediction and control of complex systems. The main reason is the enormous potential of identifying linear function space representations of nonlinear dynamics from measurements. This equally applies to ordinary, stochastic, and partial differential equations (PDEs). Until now, with a few exceptions only, the PDE case is mostly treated rather superficially, and the specific structure of the underlying dynamics is largely ignored. In this paper, we show that symmetries in the system dynamics can be carried over to the Koopman operator, which allows us to significantly increase the model efficacy. Moreover, the situation where we only have access to partial observations (i.e., measurements, as is very common for experimental data) has not been treated to its full extent, either. Moreover, we address the highly-relevant case where we cannot measure the full state, where alternative approaches (e.g., delay coordinates) have to be considered. We derive rigorous statements on the required number of observables in this situation, based on embedding theory. We present numerical evidence using various numerical examples including the wave equation and the Kuramoto-Sivashinsky equation.

math.DS↗

arXiv2024

Optimal control of port-Hamiltonian systems: energy, entropy, and exergy

We consider irreversible and coupled reversible-irreversible nonlinear port-Hamiltonian systems and the respective sets of thermodynamic equilibria. In particular, we are concerned with optimal state transitions and output stabilization on finite-time horizons. We analyze a class of optimal control problems, where the performance functional can be interpreted as a linear combination of energy supply, entropy generation, or exergy supply. Our results establish the integral turnpike property towards the set of thermodynamic equilibria providing a rigorous connection of optimal system trajectories to optimal steady states. Throughout the paper, we illustrate our findings by means of two examples: a network of heat exchangers and a gas-piston system.

math.OC↗

arXiv2024

Perturbations in PDE-constrained optimal control decay exponentially in space

For linear-quadratic optimal control problems (OCPs) governed by elliptic and parabolic partial differential equations (PDEs), we investigate the impact of perturbations on optimal solutions. Local perturbations may occur, e.g., due to discretization of the optimality system or {disturbed} problem data. Whereas these perturbations may exhibit global effects in the uncontrolled case, we prove that the ramifications are exponentially damped in space under stabilizability and detectability conditions. To this end, we prove a bound on the optimality condition's solution operator that is uniform in the domain size. Then, this uniformity is used in a scaling argument to show the exponential decay of perturbations in space. We numerically validate and illustrate our results by solving OCPs involving Helmholtz, Poisson, and advection-diffusion-reaction equations.

math.OC↗

arXiv2024

Modularized data-driven approximation of the Koopman operator and generator

Extended Dynamic Mode Decomposition (EDMD) is a widely-used data-driven approach to learn an approximation of the Koopman operator. Consequently, it provides a powerful tool for data-driven analysis, prediction, and control of nonlinear dynamical (control) systems. In this work, we propose a novel modularized EDMD scheme tailored to interconnected systems. To this end, we utilize the structure of the Koopman generator that allows to learn the dynamics of subsystems individually and thus alleviates the curse of dimensionality by considering observable functions on smaller state spaces. Moreover, our approach canonically enables transfer learning if a system encompasses multiple copies of a model as well as efficient adaption to topology changes without retraining. We provide finite-data bounds on the estimation error using tools from graph theory. The efficacy of the method is illustrated by means of various numerical examples.

eess.SY↗

arXiv2024

Data-driven MPC with terminal conditions in the Koopman framework

We investigate nonlinear model predictive control (MPC) with terminal conditions in the Koopman framework using extended dynamic mode decomposition (EDMD) to generate a data-based surrogate model for prediction and optimization. We rigorously show recursive feasibility and prove practical asymptotic stability w.r.t. the approximation accuracy. To this end, finite-data error bounds are employed. The construction of the terminal conditions is based on recently derived proportional error bounds to ensure the required Lyapunov decrease. Finally, we illustrate the effectiveness of the proposed data-driven predictive controller including the design procedure to construct the terminal region and controller.

eess.SY↗

arXiv2024

Data-driven MPC with stability guarantees using extended dynamic mode decomposition

For nonlinear (control) systems, extended dynamic mode decomposition (EDMD) is a popular method to obtain data-driven surrogate models. Its theoretical foundation is the Koopman framework, in which one propagates observable functions of the state to obtain a linear representation in an infinite-dimensional space. In this work, we prove practical asymptotic stability of a (controlled) equilibrium for EDMD-based model predictive control, in which the optimization step is conducted using the data-based surrogate model. To this end, we derive novel bounds on the estimation error that are proportional to the norm of state and control. This enables us to show that, if the underlying system is cost controllable, this stabilizablility property is preserved. We conduct numerical simulations illustrating the proven practical asymptotic stability.

math.OC↗

arXiv2024

$L^\infty$-error bounds for approximations of the Koopman operator by kernel extended dynamic mode decomposition

Extended dynamic mode decomposition (EDMD) is a well-established method to generate a data-driven approximation of the Koopman operator for analysis and prediction of nonlinear dynamical systems. Recently, kernel EDMD (kEDMD) has gained popularity due to its ability to resolve the challenging task of choosing a suitable dictionary by using the kernel's canonical features and, thus, data-informed observables. In this paper, we provide the first pointwise bounds on the approximation error of kEDMD. The main idea consists of two steps. First, we show that the reproducing kernel Hilbert spaces of Wendland functions are invariant under the Koopman operator. Second, exploiting that the learning problem given by regression in the native norm can be recast as an interpolation problem, we prove our novel error bounds by using interpolation estimates. Finally, we validate our findings with numerical experiments.

math.DS↗

arXiv2024

Variance representations and convergence rates for data-driven approximations of Koopman operators

We rigorously derive novel error bounds for extended dynamic mode decomposition (EDMD) to approximate the Koopman operator for discrete- and continuous time (stochastic) systems; both for i.i.d. and ergodic sampling under non-restrictive assumptions. We show exponential convergence rates for i.i.d. sampling and provide the first superlinear convergence rates for ergodic sampling of deterministic systems. The proofs are based on novel exact variance representations for the empirical estimators of mass and stiffness matrix. Moreover, we verify the accuracy of the derived error bounds and convergence rates by means of numerical simulations for highly-complex dynamical systems including a nonlinear partial differential equation.

math.DS↗

arXiv2024

Invariance of Gaussian RKHSs under Koopman operators of stochastic differential equations with constant matrix coefficients

We consider the Koopman operator semigroup $(K^t)_{t\ge 0}$ associated with stochastic differential equations of the form $dX_t = AX_t\,dt + B\,dW_t$ with constant matrices $A$ and $B$ and Brownian motion $W_t$. We prove that the reproducing kernel Hilbert space $\bH_C$ generated by a Gaussian kernel with a positive definite covariance matrix $C$ is invariant under each Koopman operator $K^t$ if the matrices $A$, $B$, and $C$ satisfy the following Lyapunov-like matrix inequality: $AC^2 + C^2A^\top\le 2BB^\top$. In this course, we prove a characterization concerning the inclusion $\bH_{C_1}\subset\bH_{C_2}$ of Gaussian RKHSs for two positive definite matrices $C_1$ and $C_2$. The question of whether the sufficient Lyapunov-condition is also necessary is left as an open problem.

math.PR↗

arXiv2024

Koopman-based feedback design with stability guarantees

We present a method to design a state-feedback controller ensuring exponential stability for nonlinear systems using only measurement data. Our approach relies on Koopman-operator theory and uses robust control to explicitly account for approximation errors due to finitely many data samples. To simplify practical usage across various applications, we provide a tutorial-style exposition of the feedback design and its stability guarantees for single-input systems. Moreover, we extend this controller design to multi-input systems and more flexible nonlinear state-feedback controllers using gain-scheduling techniques to increase the guaranteed region of attraction. As the proposed controller design is framed as a semidefinite program, it allows for an efficient solution. Further, we enhance the geometry of the region of attraction through a heuristic algorithm that establishes a connection between the employed Koopman lifting and the dynamics of the system. Finally, we validate the proposed feedback design procedure by means of numerical examples.

eess.SY↗

arXiv2024

Fast and memory-efficient optimization for large-scale data-driven predictive control

Recently, data-enabled predictive control (DeePC) schemes based on Willems' fundamental lemma have attracted considerable attention. At the core are computations using Hankel-like matrices and their connection to the concept of persistency of excitation. We propose an iterative solver for the underlying data-driven optimal control problems resulting from linear discrete-time systems. To this end, we apply factorizations based on the discrete Fourier transform of the Hankel-like matrices, which enable fast and memory-efficient computations. To take advantage of this factorization in an optimal control solver and to reduce the effect of inherent bad conditioning of the Hankel-like matrices, we propose an augmented Lagrangian lBFGS-method. We illustrate the performance of our method by means of a numerical study.

math.OC↗

arXiv2024

Jet space extensions of infinite-dimensional Hamiltonian systems

We analyze infinite-dimensional Hamiltonian systems corresponding to partial differential equations on one-dimensional spatial domains formulated with formally skew-adjoint Hamiltonian operators and nonlinear Hamiltonian density. In various applications, the Hamiltonian density can depend on spatial derivatives of the state such that these systems can not straightforwardly be formulated as boundary port-Hamiltonian system using a Stokes-Dirac structure. In this work, we show that any Hamiltonian system of the above class can be reformulated as a Hamiltonian system on the jet space, in which the Hamiltonian density only depends on the extended state variable itself and not on its derivatives. Consequently, well-known geometric formulations with Stokes- Dirac structures are applicable. Additionally, we provide a similar result for dissipative systems. We illustrate the developed theory by means of the the Boussinesq equation, the dynamics of an elastic rod and the Allen-Cahn equation.

math.AP↗

arXiv2023

Error bounds for kernel-based approximations of the Koopman operator

We consider the data-driven approximation of the Koopman operator for stochastic differential equations on reproducing kernel Hilbert spaces (RKHS). Our focus is on the estimation error if the data are collected from long-term ergodic simulations. We derive both an exact expression for the variance of the kernel cross-covariance operator, measured in the Hilbert-Schmidt norm, and probabilistic bounds for the finite-data estimation error. Moreover, we derive a bound on the prediction error of observables in the RKHS using a finite Mercer series expansion. Further, assuming Koopman-invariance of the RKHS, we provide bounds on the full approximation error. Numerical experiments using the Ornstein-Uhlenbeck process illustrate our results.

math.DS↗

arXiv2023

Error analysis of kernel EDMD for prediction and control in the Koopman framework

Extended Dynamic Mode Decomposition (EDMD) is a popular data-driven method to approximate the Koopman operator for deterministic and stochastic (control) systems. This operator is linear and encompasses full information on the (expected stochastic) dynamics. In this paper, we analyze a kernel-based EDMD algorithm, known as kEDMD, where the dictionary consists of the canonical kernel features at the data points. The latter are acquired by i.i.d. samples from a user-defined and application-driven distribution on a compact set. We prove bounds on the prediction error of the kEDMD estimator when sampling from this (not necessarily ergodic) distribution. The error analysis is further extended to control-affine systems, where the considered invariance of the Reproducing Kernel Hilbert Space is significantly less restrictive in comparison to invariance assumptions on an a-priori chosen dictionary.

math.DS↗

arXiv2023

Energy-optimal control of adaptive structures

Adaptive structures are equipped with sensors and actuators to actively counteract external loads such as wind. This can significantly reduce resource consumption and emissions during the life cycle compared to conventional structures. A common approach for active damping is to derive a port-Hamiltonian model and to employ linear-quadratic control. However, the quadratic control penalization lacks physical interpretation and merely serves as a regularization term. Rather, we propose a controller, which achieves the goal of vibration damping while acting energy-optimal. Leveraging the port-Hamiltonian structure, we show that the optimal control is uniquely determined, even on singular arcs. Further, we prove a stable long-time behavior of optimal trajectories by means of a turnpike property. Last, the proposed controller's efficiency is evaluated in a numerical study.

eess.SY↗

arXiv2023

Hidden regularity in singular optimal control of port-Hamiltonian systems

We study the problem of state transition on a finite time interval with minimal energy supply for linear port-Hamiltonian systems. While the cost functional of minimal energy supply is intrinsic to the port-Hamiltonian structure, the necessary conditions of optimality resulting from Pontryagin's maximum principle may yield singular arcs. The underlying reason is the linear dependence on the control, which makes the problem of determining the optimal control as a function of the state and the adjoint more complicated or even impossible. To resolve this issue, we fully characterize regularity of the (differential-algebraic) optimality system by using the interplay of the cost functional and the dynamics. In case of the optimality DAE being characterized by a regular matrix pencil, we fully determine the control on the singular arc. In case of singular matrix pencils of the optimality system, we propose an approach to compute rank-minimal quadratic perturbations of the objective such that the optimal control problem becomes regular. We illustrate the applicability of our results by a general second-order mechanical system and a discretized boundary-controlled heat equation.

math.OC↗

arXiv2023

Port-Hamiltonian formulation of Oseen flows

We present Oseen equations on Lipschitz domains in a port-Hamiltonian context. Such equations arise, for instance, by linearization of the Navier-Stokes equations. In our setup, the external port consists of the boundary traces of velocity and the normal component of the stress tensor, and boundary control is imposed by velocity and normal stress tensor prescription at disjoint parts of the boundary. We employ the recently developed theory of port-Hamiltonian system nodes for our formulation. An illustration is provided by means of flow through a cylinder.

math.AP↗