arXiv Science⌕ Search

arXiv subjects

Tren Baltussen

Publications and source records attributed to Tren Baltussen.

4 recordsLinked to original sources

Dual Model Predictive Control through Sampling-Based Belief Propagation

We propose a sampling-based dual model predictive control (MPC) approach that combines belief propagation with parameterized feedback policy optimization. By sampling uncertain dynamics and process noise, we approximate the evolution of the hyperstate over the prediction horizon, allowing future control decisions to adapt to anticipated observations and belief updates. This enables the controller to account for the future value of information without explicit exploration incentives. We establish almost-sure uniform convergence of the sample-average objective to the finite-horizon expected objective over a compact policy class. The approach is specialized to Bayesian linear regression and evaluated on stochastic systems with constant and time-varying uncertain dynamics. We compare our approach to certainty equivalent control, and an MPC that optimizes over open-loop control sequences rather than feedback policies, demonstrating the benefits of our method in terms of both control performance and information gain.

math.OC↗

The Separation Principle and the Dual-Certainty Equivalence Gap in Model Predictive Control

Dual control addresses the trade-off between exploitation and exploration, where control inputs both regulate the system and generate informative data for estimation and identification. For certain problem classes, control and estimation can be designed independently without loss of optimality, a property known as the separation principle. However, in stochastic control problems with model uncertainty and constraints, this principle generally breaks down, and introduces the need for dual control. In this paper, we propose an information-weighted dual model predictive control (MPC) formulation and introduce metrics that quantify the dependence of the MPC policy on the uncertainty. We focus on parametric uncertainty in linear systems with Gaussian noise, though the metrics can be applied more broadly. Numerical results show that the dependence of the MPC policy on the posterior covariance is largest under high uncertainty and vanishes as the posterior covariance contracts, providing empirical evidence of the dual effect in closed loop. Moreover, the dual controller improves regulation performance and model accuracy compared to certainty-equivalent MPC.

math.OC↗

Dual MPC for Active Learning of Nonparametric Uncertainties

This manuscript presents a dual model predictive controller (MPC) that balances the two objectives of dual control, namely, system identification and control. In particular, we propose a Gaussian process (GP)-based MPC that uses the posterior GP covariance for active learning. The dual MPC can steer the system towards states with high covariance, or to the setpoint, thereby balancing system identification and control performance (exploration vs. exploitation). We establish robust constraint satisfaction of the novel dual MPC through a contingency plan. We demonstrate the dual MPC in a numerical study of a nonlinear system with nonparametric uncertainties.

math.OC↗

A Contingency Model Predictive Control Framework for Safe Learning

This research introduces a multi-horizon contingency model predictive control (CMPC) framework in which classes of robust MPC (RMPC) algorithms are combined with classes of learning-based MPC (LB-MPC) algorithms to enable safe learning. We prove that the CMPC framework inherits the robust recursive feasibility properties of the underlying RMPC scheme, thereby ensuring safety of the CMPC in the sense of constraint satisfaction. The CMPC leverages the LB-MPC to safely learn the unmodeled dynamics to reduce conservatism and improve performance compared to standalone RMPC schemes, which are conservative in nature. In addition, we present an implementation of the CMPC framework that combines a particular RMPC and a Gaussian Process MPC scheme. A simulation study on automated lane merging demonstrates the advantages of our general CMPC framework.

math.OC↗