arXiv Science⌕ Search

arXiv subjects

Matthieu Barreau

Publications and source records attributed to Matthieu Barreau.

At least 19 recordsLinked to original sources

Learning Locally Stable Neural ODEs and Their Regions of Attraction

We propose a class of neural ODEs that are hard-constrained to have a locally exponentially stable equilibrium point at the origin, with an exactly characterized region of attraction. The model obtains its dynamics by passing an arbitrary neural vector field through a projection layer defined by a jointly learned Lyapunov function. By design, this function satisfies a variant of the Zubov equation for the projected dynamics and is therefore a maximal Lyapunov function for the projected system. As a result, the projected dynamics are locally exponentially stable at the origin, and the region of attraction is exactly given by the 1-sublevel set of the Lyapunov function. We prove that this model class universally approximates any sufficiently smooth dynamics that are locally exponentially stable at the origin on their region of attraction, and propose an implementation that is consistent with the theory. The approach is validated experimentally on nonlinear systems with nonconvex regions of attraction.

math.OC↗

Joint Learning of Control Lyapunov Functions and Controllers via Stable-by-Design Surrogates

Training and verifying neural network-based control Lyapunov functions (CLFs) can be computationally demanding. To address this challenge, we propose a framework that jointly learns a CLF and a stabilizing controller using structured neural networks and a projection-based parameterization. Specifically, we employ Polyak-Lojasiewicz networks (PLNets), which parameterize nonconvex, positive-definite CLF candidates, and construct a stable-by-design surrogate of the closed-loop dynamics that satisfies the Lyapunov decrease condition by construction. The controller combines linear state feedback with a higher-order correction term resembling Sontag's universal formula and is trained to align the resulting closed-loop dynamics with the stable-by-design surrogate. Unlike classical approaches based on Sontag's formula, our framework does not require a known CLF; instead, it learns the CLF and controller simultaneously. We establish local and global stability guarantees for the learned controller and demonstrate the effectiveness of the proposed approach through numerical examples.

eess.SY↗

Efficient Modeling of Multi-Agent Systems via Structure-Aware Physics-Informed Learning

Modeling large multi-agent systems poses challenges for trajectory inference and parameter identification, as network size and coupling increase computational demands and partial observations require reconstructing unobserved states. We propose MAS-PINN, a neural-network architecture with a tailored training algorithm for a physics-informed learning framework that leverages the network topology and the agents' similarity to reduce computational and memory costs of simulating and identifying multi-agent systems. Its architecture represents agent trajectories through shared temporal features and agent-specific coefficients. Training alternates between learning features, fitting coupled trajectories, and estimating physical parameters. A matrix-free update exploits local interactions to fit trajectories without forming large global matrices. Experiments on Lorenz rings, Lotka--Volterra networks, and Rössler oscillators show improved trajectory and parameter accuracy over baselines, including inference in large systems and identification under partial observations or unknown topology, alongside substantial computational savings in coefficient fitting.

cs.LG↗

Learning Maximal Regions of Attraction on Compact Sets using Taylor Lyapunov Networks

We consider the problem of learning maximal Lyapunov functions to compute the maximal region of attraction of nonlinear dynamical systems using neural networks. Two obstacles limit existing neural-network approaches: 1) finite-width approximations can fail to preserve the strict Lyapunov inequalities near the equilibrium, where they become arbitrarily weak, and 2) training is necessarily performed on a bounded computational domain for which the classical Lyapunov and Zubov theorems do not directly apply. To address these issues, first we derive Lyapunov and Zubov theorems directly on a prescribed compact computational domain, characterizing the maximal region of attraction within that domain as the solution of a boundary-value PDE. Second, we introduce the Taylor Lyapunov network, an architecture that prescribes the quadratic leading-order term via the system's linearization and represents the higher-order remainder through a structured cubic factorization, guaranteeing that any network in this class is a valid local Lyapunov function by construction. Finally, we prove that Taylor Lyapunov networks are universal approximators of maximal Lyapunov functions on compact domains, and combine these results into an unsupervised, physics-informed training procedure. Numerical experiments on systems of varying dimensions and stability types show that the proposed architecture is efficient at estimating the maximum region of attraction.

math.OC↗

A Semigroup-Aware Kernel Neural Operator with Latent Exponential Integration for Forced PDEs

We propose a semigroup-aware structured kernel neural operator for source-driven evolution PDEs. Unlike generic time-conditioned kernel models, the proposed formulation represents temporal dependence through a latent exponential propagator \(e^{tA_θ}\), where \(A_θ\) is a learned latent generator. This provides a structured transition from a non-ODE kernel representation to an ODE-inspired kernel operator whose latent temporal evolution satisfies the composition principle of evolution semigroups. For time-dependent forcing terms, a direct kernel-based evaluation requires repeated quadrature over delayed kernel evaluations. To address this computational bottleneck, we derive a latent-first reformulation of the source term: the forcing field is projected onto the kernel-induced latent space, where its accumulated effect is represented as the solution of a forced linear latent dynamical system. For a fixed learned kernel, this reformulation is exact. The resulting system can then be integrated using a \(ϕ_1\)-based exponential integrator, yielding a source-evaluation path that is structurally aligned with the learned latent propagator. The resulting framework combines geometry- and physics-conditioned low-rank kernel factorization with alternative source-evaluation paths based on either explicit Duhamel quadrature or latent exponential integration. Dissipativity constraints on the latent generator and identity-preserving corrections near the initial time are optional architectural components. Numerical experiments on advection-iffusion-reaction (ADR) problems compare the non-ODE and semigroup-aware formulations, evaluate the quadrature and \(ϕ_1\) source paths, and assess predictive accuracy and computational cost.

math.NA↗

Region of Attraction Estimation for Linear Quadratic Regulator, Linear and Robust Model Predictive Control on a Two-Wheeled Inverted Pendulum

Nonlinear underactuated systems such as two-wheeled inverted pendulums (TWIPs) exhibit a limited region of attraction (RoA), which defines the set of initial conditions from which the closed-loop system converges to the equilibrium. The RoA of nonlinear and constrained systems is generally nonconvex and analytically intractable, requiring numerical or approximate estimation methods. This work investigates the estimation of the RoA for a TWIP stabilized under three model-based control strategies: saturated linear quadratic regulator (LQR), linear model predictive control (MPC), and constraint tightening MPC (CTMPC). We first derive a Lyapunov-based invariant set that provides a certified inner approximation of the RoA. Since this analytical bound is highly conservative, a Monte Carlo-based estimation procedure is then employed to obtain a more representative approximation of the RoA, capturing how the controllers behave beyond the analytically guaranteed region. The proposed methodology combines analytical guarantees with data-driven estimation, providing both a formally certified inner bound and an empirical characterization of the RoA, offering a practical way to evaluate controller performance without relying solely on conservative analytical bounds or purely empirical simulation.

eess.SY↗

Data-driven multi-agent modelling of calcium interactions in cell culture: PINN vs Regularized Least-squares

Data-driven discovery of dynamics in biological systems allows for better observation and characterization of processes, such as calcium signaling in cell culture. Recent advancements in techniques allow the exploration of previously unattainable insights of dynamical systems, such as the Sparse Identification of Non-Linear Dynamics (SINDy), overcoming the limitations of more classic methodologies. The latter requires some prior knowledge of an effective library of candidate terms, which is not realistic for a real case study. Using inspiration from fields like traffic density estimation and control theory, we propose a methodology for characterization and performance analysis of calcium delivery in a family of cells. In this work, we compare the performance of the Constrained Regularized Least-Squares Method (CRLSM) and Physics-Informed Neural Networks (PINN) for system identification and parameter discovery for governing ordinary differential equations (ODEs). The CRLSM achieves a fairly good parameter estimate and a good data fit when using the learned parameters in the Consensus problem. On the other hand, despite the initial hypothesis, PINNs fail to match the CRLSM performance and, under the current configuration, do not provide fair parameter estimation. However, we have only studied a limited number of PINN architectures, and it is expected that additional hyperparameter tuning, as well as uncertainty quantification, could significantly improve the performance in future works.

q-bio.QM↗

Learning Traffic Flow Dynamics with Stochastic Physics-Informed Neural Cellular Automata

Traffic flow modeling is essential for understanding and predicting the collective dynamics of vehicles on road networks. Cellular automata provide a simple, interpretable yet powerful framework for representing these dynamics via local interaction rules, while retaining the ability to reproduce complex macroscopic traffic phenomena. However, learning local transition rules from data while preserving physically meaningful constraints remains challenging, particularly for stochastic models. In this work, we propose a physics-informed neural cellular automaton (PI-NCA) for data-driven traffic flow modeling. Building on the standard neural cellular automaton (NCA), we design a neural architecture that is physically consistent with the road topology and guarantees conservation of the total number of vehicles, thereby constraining the learned transition rules to physically admissible dynamics. We further extend this framework to stochastic dynamics by parameterizing probabilistic transition rules while preserving the same physics-informed constraints. We evaluate the proposed models on multiple traffic scenarios generated by the well-established Nagel-Schreckenberg and Kerner-Klenov-Wolf cellular automata. The results demonstrate that the PI-NCA successfully learns the dynamics of both traffic models and consistently outperforms a standard NCA, while the stochastic extension captures probabilistic transition rules without compromising the imposed physical constraints.

cs.LG↗

KKL Observer Synthesis for Nonlinear Systems via Physics-Informed Learning

This paper proposes a novel learning approach for designing Kazantzis-Kravaris or nonlinear Luenberger (KKL) observers for autonomous nonlinear systems. The design of a KKL observer involves finding an injective map that transforms the system state into a higher-dimensional observer state, whose dynamics is linear and stable. The observer's state is then mapped back to the original system coordinates via the inverse map to obtain the state estimate. However, finding this transformation and its inverse is quite challenging. We propose learning the forward mapping using a physics-informed neural network, and then learning its inverse mapping with a conventional feedforward neural network. Theoretical guarantees for the robustness of state estimation against approximation error and system uncertainties are provided, including non-asymptotic learning guarantees that link approximation quality to finite sample sizes. The effectiveness of the proposed approach is demonstrated through numerical simulations on benchmark examples, showing better generalization capability outside the training domain compared to state-of-the-art methods.

eess.SY↗

Iterative Training of Physics-Informed Neural Networks with Fourier-enhanced Features

Spectral bias, the tendency of neural networks to learn low-frequency features first, is a well-known issue with many training algorithms for physics-informed neural networks (PINNs). To overcome this issue, we propose IFeF-PINN, an algorithm for iterative training of PINNs with Fourier-enhanced features. The key idea is to enrich the latent space using high-frequency components through Random Fourier Features. This creates a two-stage training problem: (i) estimate a basis in the feature space, and (ii) perform regression to determine the coefficients of the enhanced basis functions. For an underlying linear model, it is shown that the latter problem is convex, and we prove that the iterative training scheme converges. Furthermore, we empirically establish that Random Fourier Features enhance the expressive capacity of the network, enabling accurate approximation of high-frequency PDEs. Through extensive numerical evaluation on classical benchmark problems, the superior performance of our method over state-of-the-art algorithms is shown, and the improved approximation across the frequency domain is illustrated.

cs.LG↗

Alternating Levenberg-Marquardt Training of Physics-Informed Neural Networks with Fourier-Enhanced Features

Physics-informed neural networks (PINNs) often fail to accurately resolve partial differential equations (PDEs) with high-frequency or multi-scale solutions, as well as strongly nonlinear problems. Two factors underlie this difficulty: spectral bias, the tendency of neural networks to underfit high-frequency features; and representation-coefficient coupling, the entanglement of representation learning and coefficient fitting within a single nonconvex optimization objective. In this work, we propose the Fourier-enhanced alternating Levenberg--Marquardt PINN (FALM-PINN), an optimization framework that decouples representation learning from coefficient fitting. The upper-level problem learns a Fourier-enhanced basis that enriches the latent space with high-frequency components, while the lower-level problem resolves the coupling by fitting the projection coefficients on this basis, solving a nonlinear least-squares problem with the Levenberg--Marquardt algorithm. The framework applies to general nonlinear and coupled PDE systems, and reduces to a single-step convex optimization problem for linear PDEs. We prove global convergence of the alternating training scheme in both cases. Numerical examples on multiple challenging high-frequency and nonlinear PDEs show that FALM-PINN achieves relative $L^2$ errors up to two orders of magnitude lower than state-of-the-art baselines.

cs.LG↗

Learning Neural Maximal Lyapunov Functions on $\mathsf{SO}(n)$

Establishing stability guarantees for dynamical systems on Lie groups is a fundamental challenge, as classical Lyapunov methods developed for Euclidean spaces do not directly transfer to curved geometries. In this paper, we propose a framework for learning maximal Lyapunov functions for systems evolving on the special orthogonal group $\mathsf{SO}(n)$. Theoretically, we introduce a neural Lyapunov architecture based on the logarithmic map with proven approximation capabilities, and we formulate the learning problem via a Zubov-type characterization of the maximal region of attraction. A key technical contribution is the derivation of explicit, numerically tractable formulas for the derivative of the logarithmic map, enabling training through a two-phase algorithm that balances computational efficiency and accuracy. Empirically, we validate the approach on a low-dimensional nonlinear system.

math.OC↗

Hybrid System Identification of Electric Freight Transition Dynamics via SINDy and Neural ODEs

The transition to electric heavy-duty freight is constrained by a strong interdependence between vehicle adoption and charging infrastructure deployment. While system dynamics models are well-suited to simulate these socio-technical feedback loops, their reliance on conditional logic and heuristic rules makes the underlying dynamics difficult to interpret mathematically. This limits the direct application of formal systems and control theory. This paper proposes a solution to that problem through a general hybrid system identification framework that extracts a continuous-time analytical surrogate from simulations of complex system dynamics. The approach combines the sparse identification of nonlinear dynamics algorithm with neural ordinary differential equations to form a grey-box model. The first component identifies the dominant interpretable dynamics under causal coupling constraints, while the neural residual captures unmodelled nonlinearities. The framework is trained using multiple shooting over a 40-year horizon. The resulting model reproduces the training trajectories with a normalized root-mean-square error below 4\%, while maintaining reliable predictive accuracy when evaluated on unseen initial conditions.

math.OC↗

Physics-Informed Detection of Friction Anomalies in Satellite Reaction Wheels

As the number of satellites in orbit has increased exponentially in recent years, ensuring their correct functionality has started to require automated methods to decrease human workload. In this work, we present an algorithm that analyzes the on-board data related to friction from the Reaction Wheel Assemblies (RWA) of a satellite and determines their operating status, distinguishing between nominal status and several possible anomalies that require preventive measures to be taken. The algorithm first uses a model based on hybrid systems theory to extract the information relevant to the problem. The extraction process combines techniques in changepoint detection, dynamic programming, and maximum likelihood in a structured way. A classifier then uses the extracted information to determine the status of the RWA. This last classifier has been previously trained with a labelled dataset produced by a high-fidelity simulator, comprised for the most part of nominal data. The final algorithm combines model-based and data-based approaches to obtain satisfactory results with an accuracy around 95%.

eess.SY↗

Model-free Anomaly Detection for Dynamical Systems with Gaussian Processes

In this paper we address the problem of detecting differences or anomalies in a dynamical system, based on historical data of nominal operations. This problem encompasses quality control, where newly manufactured systems are tested against desired nominal operations, and the detection of changes in the dynamics due to degradation or repairs. We propose a model free approach based on Gaussian processes (GPs). The idea is to train offline a GP based on nominal data, which is then deployed online to detect whether measurements of the system state are compatible with nominal operations or if they deviate. Detecting this deviation is made more challenging by the presence of process and measurement noise, which might obfuscate deviations in the dynamics. The detection then is based on a threshold that ensures a specific false positive rate. We showcase the promising performance of the proposed method with two systems, and highlight several interesting future research questions.

eess.SY↗

Detectability of Subtle Anomalies in Dynamical Systems via Log-Likelihood Ratio

Industrial control applications require detecting system anomalies as accurately and quickly as possible to enable prompt maintenance. In this context, it is common to consider several possible plant models, each linked to a different anomaly. The log-likelihood ratio method can then be used to identify the most accurate model and thereby classify which anomaly, if any, has occurred. Although the method has been applied to a wide variety of systems, there is no formal analysis of what makes anomalies more or less prone to detection. In this paper, we investigate a real-time anomaly detector based on the log-likelihood ratio and provide a theoretical characterization of its error rate when it is applied to linear Gaussian systems. We showcase the performance of this algorithm and the characterization obtained, and demonstrate how the latter can be leveraged for observer design.

eess.SY↗

Curriculum-Learned Vanishing Stacked Residual PINNs for Hyperbolic PDE State Reconstruction

Modeling distributed dynamical systems governed by hyperbolic partial differential equations (PDEs) remains challenging due to discontinuities and shocks that hinder the convergence of traditional physics-informed neural networks (PINNs). The recently proposed vanishing stacked residual PINN (VSR-PINN) embeds a vanishing-viscosity mechanism within stacked residual refinements to enable a smooth transition from the parabolic to hyperbolic regime. This paper integrates three curriculum-learning methods as primal-dual (PD) optimization, causality progression, and adaptive sampling into the VSR-PINN. The PD strategy balances physics and data losses, the causality scheme unlocks deeper stacks by respecting temporal and gradient evolution, and adaptive sampling targets high residuals. Numerical experiments on traffic reconstruction confirm that enforcing causality systematically reduces the median point-wise MSE and its variability across runs, yielding improvements of nearly one order of magnitude over non-causal training in both the baseline and PD variants.

cs.NE↗

A Control Perspective on Training PINNs

We investigate the training of Physics-Informed Neural Networks (PINNs) from a control-theoretic perspective. Using gradient descent with resampling, we interpret the training dynamics as asymptotically equivalent to a stochastic control-affine system, where sampling effects act as process disturbances and measurement noise. Within this framework, we introduce two controllers for dynamically adapting the physics weight: an integral controller and a leaky integral controller. We theoretically analyze their asymptotic properties under the accuracy-robustness trade-off, and we evaluate them on a toy example. Numerical evidence suggests that the integral controller achieves accurate and robust convergence when the physical model is correct, whereas the leaky integrator provides improved performance in the presence of model mismatch. This work represents a first step toward convergence guarantees and principled training algorithms tailored to the distinct characteristics of PINN tasks.

cs.LG↗