arXiv ScienceSearch

arXiv subjects

Sebastian Zieglmeier

Publications and source records attributed to Sebastian Zieglmeier.

7 recordsLinked to original sources

Model-Free Control for Residential Heating: Deployment and Simulation of Nonlinear Data-Enabled Predictive Control

Residential heating accounts for a large share of building energy use, and predictive control strategies can reduce it by anticipating rather than reacting to the room temperature alone. The usual manner of implementing predictive control, model predictive control (MPC), requires an accurate model of each individual residential unit for heating control. Obtaining this model is time-consuming to obtain manually or even impossible, and such models do not transfer across a heterogeneous building stock. Data-enabled predictive control (DeePC) removes this modeling step by designing the controller directly using measured trajectories of the system. The foundations of DeePC, however, are built on the class of deterministic linear time-invariant systems, which is an unrealistic assumption for residential heating. This work applies three recently proposed nonlinear extensions of DeePC, collectively referred to as data-driven predictive control (DPC): Select-DPC, gain-scheduling DPC, and linear parameter-varying DPC. These are compared against standard DeePC and the hysteresis controller, the industry standard in residential heating. The comparison runs over a full heating season on a calibrated digital twin of an occupied research unit, the NEST research building in Switzerland, assessed by heating energy and comfort-band violation. Moreover, gain-scheduling DPC was deployed on the real residential apartment and validated the conclusions from the simulations. Each of the DPC controllers consumes significantly less energy than the hysteresis controller, amounting to roughly $11\%$ over the season, validating the use of DPC. The nonlinear methods further outperform linear DeePC in all assessed scenarios, and we analyze the relative costs and benefits of each nonlinear method.

eess.SY

Data-driven predictive control of nonlinear systems using weighted regularization

Data-driven control methods, like Data-enabled Predictive Control (DeePC), are often formulated for linear systems, where the principle of superposition allows global system behavior to be inferred from locally collected data through Willems' fundamental lemma. This principle does not hold for nonlinear systems, whose dynamics may vary across operating regions. We propose a data-driven predictive control framework for nonlinear systems that incorporates data column preferences according to their proximity to the current operating point through a weighted norm regularization, thereby localizing the predictor without discarding any data. We show how the proposed weighting scheme induces operating point-dependent data prioritization and ensures a well-posed optimization problem. A numerical study on a nonlinear two-tank system demonstrates that the proposed method matches or outperforms hard data-selection schemes while retaining the full data matrix and its rank, thereby guaranteeing feasibility.

eess.SY

Scenario-based Data-Enabled Predictive Control: Robustification via the Scenario Approach

This paper proposes Scenario-Based Data-Enabled Predictive Control (Scenario-DeePC), which integrates the scenario optimization framework into Data-enabled Predictive Control (DeePC) to provide probabilistic guarantees on constraint satisfaction under uncertainty. In contrast to existing methods, the uncertainty is characterized directly from data by constructing empirical disturbance scenarios from observed prediction errors, keeping the method fully consistent with the data-driven philosophy of DeePC and free of distributional assumptions. We establish the supporting theory, including a distribution-free probabilistic guarantee on constraint satisfaction and recursive feasibility of the receding-horizon scheme. An adaptive extension collects scenarios online, enabling the controller to adjust to changing noise characteristics, disturbances, and operating-point-dependent model mismatches. The approach is demonstrated on a linear Boeing 747 model and a nonlinear two-tank system, showing a significant reduction in constraint violations compared to standard DeePC, while maintaining comparable tracking performance in nominal conditions and improving tracking accuracy in the nonlinear setting.

eess.SY

Data-Enabled Predictive Control with Predictive Adaptive Line-of-Sight Guidance for 3-D Path Following of Autonomous Underwater Vehicles

This paper presents a fully data-driven 3-D path-following framework for autonomous underwater vehicles (AUVs), a representative class of underwater field robotics, based on Data-Enabled Predictive Control (DeePC). The approach eliminates explicit hydrodynamic modeling by exploiting measured input-output trajectories to predict and optimize future system behavior. Classic DeePC is employed for heading control, while a cascaded DeePC architecture with loop-frequency separation is proposed for depth regulation, extending DeePC to plants whose dominant output evolves significantly slower than the actuator bandwidth. For 3-D waypoint path following, the Adaptive Line-of-Sight (ALOS) guidance law is extended to a predictive multistep formulation (PALOS) that supplies the horizon-consistent reference required by receding-horizon predictive controllers. All methods are validated in high-fidelity 6 degrees of freedom simulation on the REMUS~100 AUV under nominal operation, ocean-current disturbances, operation beyond the data regime, and 3-D waypoint path following, consistently outperforming the corresponding state-of-the-art benchmarks. In 3-D waypoint path following, the framework reduces cross-track error by approximately 28\% relative to the ALOS-PI/PID baseline.

eess.SY

Gain-Scheduling Data-Enabled Predictive Control for Nonlinear Systems with Linearized Operating Regions

This paper presents a Gain-Scheduled Data-Enabled Predictive Control (GS-DeePC) framework for nonlinear systems based on multiple locally linear data representations. Instead of relying on a single global Hankel matrix, the operating range of a measurable scheduling variable is partitioned into regions, and regional Hankel matrices are constructed from persistently exciting data. To ensure smooth transitions between linearization regions and suppress region-induced chattering, composite regions are introduced, merging neighboring data sets and enabling a robust switching mechanism. The proposed method maintains the original DeePC problem structure and can achieve reduced computational complexity by requiring only short, locally informative data sequences. Extensive experiments on a nonlinear DC-motor with an unbalanced disc demonstrate the significantly improved control performance compared to standard DeePC.

eess.SY

Reinforcement Learning for Pollution Detection in a Randomized, Sparse and Nonstationary Environment with an Autonomous Underwater Vehicle

Reinforcement learning (RL) algorithms are designed to optimize problem-solving by learning actions that maximize rewards, a task that becomes particularly challenging in random and nonstationary environments. Even advanced RL algorithms are often limited in their ability to solve problems in these conditions. In applications such as searching for underwater pollution clouds with autonomous underwater vehicles (AUVs), RL algorithms must navigate reward-sparse environments, where actions frequently result in a zero reward. This paper aims to address these challenges by revisiting and modifying classical RL approaches to efficiently operate in sparse, randomized, and nonstationary environments. We systematically study a large number of modifications, including hierarchical algorithm changes, multigoal learning, and the integration of a location memory as an external output filter to prevent state revisits. Our results demonstrate that a modified Monte Carlo-based approach significantly outperforms traditional Q-learning and two exhaustive search patterns, illustrating its potential in adapting RL to complex environments. These findings suggest that reinforcement learning approaches can be effectively adapted for use in random, nonstationary, and reward-sparse environments.

cs.LG

Semi-Data-Driven Model Predictive Control: A Physics-Informed Data-Driven Control Approach

Data-enabled predictive control (DeePC) has emerged as a powerful technique to control complex systems without the need for extensive modeling efforts. However, relying solely on offline collected data trajectories to represent the system dynamics introduces certain drawbacks. Therefore, we present a novel semi-data-driven model predictive control (SD-MPC) framework that combines (limited) model information with DeePC to address a range of these drawbacks, including sensitivity to noisy data and a lack of robustness. In this work, we focus on the performance of DeePC in operating regimes not captured by the offline collected data trajectories and demonstrate how incorporating an underlying parametric model can counteract this issue. SD-MPC exhibits equivalent closed-loop performance as DeePC for deterministic linear time-invariant systems. Simulations demonstrate the general control performance of the proposed SD-MPC for both a linear time-invariant system and a nonlinear system modeled as a linear parameter-varying system. These results provide numerical evidence of the enhanced robustness of SD-MPC over classical DeePC.

eess.SY