arXiv Science⌕ Search

arXiv subjects

Florian Dörfler

Publications and source records attributed to Florian Dörfler.

At least 37 records · Page 2Linked to original sources

Fundamental Limitations of Data-Driven Control: A Statistical Decision Perspective

Substantial research efforts have been devoted to the design of data-driven controllers; however, comparatively less is known about their statistical performance and fundamental limitations. This contribution develops a statistical decision framework for data-driven control, in which a controller is evaluated by its risk, defined as the expected performance degradation relative to the oracle model-based controller, and by its average risk over the parameter space. Within this framework, we propose a collection of design principles for data-driven controllers. We further derive lower bounds on risks by combining the bias-variance decomposition with the Cramér-Rao inequality. In particular, the optimal bias that attains the lower bound for the average risk is determined by calculus of variations, thereby making the bias-variance tradeoff in data-driven control explicit. Moreover, the derived bound reveals a ``waterbed'' effect in data-driven control: any improvement in risk relative to the lower bound over one region of the parameter space must be compensated by deterioration elsewhere. We illustrate the proposed framework on two canonical data-driven control problems: optimal feedforward control and the linear quadratic regulator benchmark. By comparing several representative data-driven controllers with the derived lower bounds, we sharpen the statistical interpretation of existing methods and reveal quantitative limitations that no controller design can avoid.

eess.SY↗

Gaussian behaviors and stochastic data-driven control

We propose a stochastic behavioral modeling framework, termed Gaussian behaviors, which augments a deterministic linear time-invariant (LTI) behavior with a Gaussian noise component. We show that this notion is a tractable subclass of stochastic behaviors and encompasses classical parametric stochastic LTI state-space system models as special cases. Analogously to deterministic LTI behaviors, the framework enables simple and tractable stochastic data-driven control methods. To this end, we obtain a method for prediction by conditioning the Gaussian behavior on the known part of the trajectory, which is identified directly from the sample covariance of trajectory data. Building on this method, we develop predictive control formulations that optimize over feedforward or disturbance affine feedback policies. The resulting formulations are shown to be convex. We further derive a finite-sample confidence bound on the prediction accounting for both aleatoric and epistemic uncertainty, and incorporate it into a robust control method, for which a tractable convex upper bound is obtained. Within this framework, subspace predictive control is recovered when only the mean prediction is used, while data-enabled predictive control is shown to account for the prediction uncertainty in an optimistic fashion. Numerical case studies illustrate the benefits of the proposed methods.

eess.SY↗

Geometric Decentralized Stability Certificate of Power Electronics-Dominated Power Systems Covering Variable Operating Points

The integration of power converters is profoundly changing the power system dynamics and poses significant challenges for stability analysis. The dynamic interactions between the power grid and the heterogeneous converters are highly complex and difficult to analyze due to the curse of dimensionality. Moreover, system stability varies with the operating points, which are determined by the voltage magnitude, active power, and reactive power of each converter. This further complicates the analysis as it is difficult to enumerate and examine all the possible operating points. To tackle these challenges, this paper proposes a geometric decentralized stability certificate for power electronics (PE)-dominated power systems, which can simultaneously handle heterogeneous power converters and their variable operating points. The certificate can be checked in a decentralized and modular manner, and it is scalable for large-scale power systems. Our approach is developed based on the concept of Davis-Wielandt (DW) shell and its projections, which can effectively visualize the characteristics of high-dimensional complex matrices. We investigate how the projections of the DW shell vary with operating points and how this variation can guide the search for worst-case operating conditions. We further propose an efficient algorithm to compute the stability margin and construct the certified operating regions. The effectiveness of the proposed method is validated through case studies on single-converter and 54-converter wind power systems.

eess.SY↗

Variational Analysis in the Wasserstein Space

We study optimization problems whereby the optimization variable is a probability measure. Since the space of probability measures is not a vector space, many classical methods for optimization (e.g., gradients) do not directly apply. Thus, one typically resorts to the abstract machinery of infinite-dimensional analysis or other ad-hoc methodologies, not tailored to the space of probability measures, which however involve projections or rely on convexity-type assumptions. We believe instead that these problems call for a comprehensive methodological framework for calculus in the space of probability measures. In this work, we combine ideas from optimal transport, variational analysis, and Wasserstein gradient flows to equip the Wasserstein space (i.e., the space of probability measures endowed with the Wasserstein distance) with a variational structure, both by combining and extending existing results and introducing novel tools. Our theoretical analysis culminates in general necessary optimality conditions. These conditions (i) resemble the optimality conditions in Euclidean spaces, such as the KKT conditions, (ii) are intuitive, informative, and easy to study, and (iii) yield closed-form solutions or can be used to design computationally attractive algorithms. We accompany our theoretical results with numerous examples and present applications to machine learning, drug discovery, and distributionally robust optimization.

math.OC↗

Adaptive Linear Quadratic Control of Unknown Linear Time-Varying Systems via Policy Gradient Methods

Unknown linear time-varying (LTV) systems require the control policy to adapt from online closed-loop data as dynamics evolve. Existing methods usually update the policy by solving a one-shot optimization problem, which can be computationally demanding and sensitive to noisy model estimates. In this paper, we propose a policy gradient adaptive control (PGAC) method for LTV system control with unknown model parameters. Specifically, PGAC integrates online policy optimization into feedback by updating the state-feedback policy with one-step gradient descent of the linear quadratic regulator cost at each time instant. This incremental update is computationally light and naturally limits policy variations caused by noisy data. To explicitly compute the policy gradient online, we estimate local models from recent closed-loop trajectories using normalized sliding-window least-squares. We provide stability and convergence certificates of PGAC for two classes of LTV systems. For slowly time-varying systems, we prove that the closed-loop system achieves practical exponential stability without a dwell-time condition. For piecewise-constant LTV systems, we establish practical stability through a dwell-time contraction argument. We also provide average frozen-time optimality-gap bounds of the policy sequence for both classes. Finally, we validate the effectiveness of our method via numerical case studies of both LTV and nonlinear systems.

math.OC↗

Dissipativity-Based Data-Driven Decentralized Control of Interconnected Systems

We propose data-driven decentralized control algorithms for stabilizing interconnected discrete-time linear time-invariant systems. We first derive a data-driven condition to synthesize a local controller that ensures the dissipativity of the local subsystems. Then, we propose data-driven decentralized stability conditions for the global system based on the dissipativity of each local system. Since both conditions take the form of linear matrix inequalities and are based on dissipativity theory, this yields a unified pipeline, resulting in a data-driven decentralized control algorithm. As a special case, we also consider stabilizing systems interconnected through diffusive coupling and propose a control algorithm. We validate the effectiveness and the scalability of the proposed control algorithms in numerical examples in the context of microgrids.

eess.SY↗

A Coalitional Stable and Fair Reward Allocation for Dynamic Virtual Power Plants

This paper establishes crucial cooperation criteria for the operation of Dynamic Virtual Power Plants (DVPPs). We propose a control design and reward allocation mechanism to enable and incentivize Distributed Energy Resources (DERs) to provide dynamic ancillary services (DAS). Our results illustrate how the cooperative aggregation of heterogeneous DERs leverages technical complementarities to outperform standalone DAS provision. The proposed reward allocation fulfills critical game-theoretic criteria, including individual rationality, coalitional stability, incentive compatibility, optimality, fairness and ex-post consistency. The control design and reward allocation are validated using a case study based on the Finnish power grid.

eess.SY↗

Distributionally Robust Linear Quadratic Gaussian Regulator with Stationary Distributions

We study the Linear Quadratic Gaussian regulation problem in the face of worst-case noise distributions when these are mutually independent, zero-mean, stationary, and within a radius (as measured by the Wasserstein distance) of some reference Gaussian noise distributions. Compared with nonstationary ambiguity models, our stationary modeling choice reduces conservatism when the disturbances are stationary, as is often the case in practice. We first show optimality of linear output-feedback policies via the existence of a Nash equilibrium in an equivalent zero-sum game between a control engineer and a fictitious adversary that compete to minimize and maximize the control cost. Additionally, we show that Nash equilibria may fail to exist when the distributions are not restricted to have zero mean. We then propose an iterated best-response algorithm to compute Nash equilibria and thereby the optimal feedback policies. Our computational framework unifies two seemingly different viewpoints: game-theoretic iterated best response and Frank-Wolfe approaches. Finally, we illustrate the robustness of the proposed controller to unknown noise distributions on an inverted pendulum with physical parameters, a canonical control benchmark.

math.OC↗

Gray-Box Nonlinear Feedback Optimization

Feedback optimization enables autonomous optimality seeking of a dynamical system through its closed-loop interconnection with iterative optimization algorithms. Among various iteration structures, model-based approaches require the input-output sensitivity matrix of the system to construct gradients, whereas model-free approaches eliminate this need by estimating gradients from real-time objective evaluations. These approaches offer complementary benefits in sample efficiency and accuracy against model mismatch, i.e., sensitivity errors. To achieve balanced closed-loop performance, we propose a gray-box feedback optimization controller, featuring systematic incorporation of approximate sensitivities into model-free updates via a tunable convex combination. We provide unified performance characterizations covering different approaches. We elucidate how cumulative sensitivity errors (model-based) and variances due to stochastic exploration (model-free) shape the closed-loop behavior and induce a trade-off between iteration and dimensional dependence. The proposed controller retains sample efficiency and provable (local) optimality for nonconvex problems despite inaccurate sensitivities. We further develop and characterize a running gray-box controller that handles constrained time-varying problems with changing objectives and steady-state input-output maps.

math.OC↗

From droop to optimality: The potential of volt/var control for power distribution grid enhancement

When high amounts of active power are injected into power distribution grids, the overall power flow is limited because voltages reach their upper acceptable limits. Volt/var control aims to raise this power flow limit without physically reinforcing the grid but by controlling the voltage using reactive power. We use real consumption and generation data on a low-voltage CIGRÉ grid model and an experiment on a real distribution grid feeder to analyze how different volt/var methods can enhance the grid. We show that local droop control enhances the grid but underutilizes the reactive power resources. We discuss how this inefficiency can be partly reduced by fine-tuning the droop curves through data-driven techniques but illustrate that inherent trade-off persist for any local control method. We finally demonstrate that coordinated control methods can track the optimal solution and enhance the grid to its full potential if grid-wide communication is available. Our numerical study over a whole year of real data suggests that coordinated volt/var control can enable another 10.4% of maximum active power injections compared to droop control. In a small-scale real-life experiment, coordinated control enhanced the grid by the same amount.

eess.SY↗

Choose Wisely: Data-driven Predictive Control for Nonlinear Systems Using Online Data Selection

This paper proposes Select-Data-driven Predictive Control (Select-DPC), a new method for controlling nonlinear systems using output-feedback for which data are available but an explicit model is not. At each timestep, Select-DPC employs only the most relevant data to implicitly linearize the dynamics in "trajectory space". Then, taking user-defined output constraints into account, it makes control decisions using a convex optimization. This optimal control is applied in a receding-horizon manner. As the online data-selection is the core of Select-DPC, we propose and verify both norm-based and manifold-embedding-based selection methods. We evaluate Select-DPC on three benchmark nonlinear system simulators -- rocket-landing, a robotic arm and cart-pole inverted pendulum swing-up -- comparing them with standard Data-enabled Predictive Control (DeePC) and Time-Windowed DeePC methods, and find that Select-DPC outperforms both methods.

eess.SY↗

Decentralized Parametric Stability Certificates for Grid-Forming Converter Control

We propose a decentralized framework to analytically guarantee the small-signal stability of future power systems with grid-forming converters. Our approach leverages dynamic loop-shifting techniques to compensate for the lack of passivity in the network dynamics and establishes decentralized parametric stability certificates, depending on the local device-level controls and incorporating the effects of the network. By following practical tuning rules, we are able to ensure plug-and-play operation without centralized coordination. Unlike prior works, our approach accommodates coupled frequency and voltage dynamics, incorporates network dynamics, and does not rely on specific network configurations or operating points, offering a general and scalable solution for the integration of power-electronics-based devices into future power systems. We validate our theoretical stability results through numerical case studies in a high-fidelity simulation model.

eess.SY↗

A Spatially Informed Gaussian Process UCB Method for Decentralized Coverage Control

We present a novel decentralized algorithm for coverage control in unknown spatial environments modeled by Gaussian Processes (GPs). To trade-off between exploration and exploitation, each agent autonomously determines its trajectory by minimizing a local cost function. Inspired by the GP-UCB (Upper Confidence Bound for GPs) acquisition function, the proposed cost combines the expected locational cost with a variance-based exploration term, guiding agents toward regions that are both high in predicted density and model uncertainty. Compared to previous work, our algorithm operates in a fully decentralized fashion, relying only on local observations and communication with neighboring agents. In particular, agents periodically update their inducing points using a greedy selection strategy, enabling scalable online GP updates. We demonstrate the effectiveness of our algorithm in simulation.

cs.LG↗

Incentive-Based Load Curtailment with Limited Information: A Bilevel Zeroth-Order Learning Approach

Incentive-based load curtailment unlocks critical demand-side flexibility but is hindered by the limited knowledge of private user parameters and the inherent nonsmoothness of responses due to physical device constraints. We address this via a constrained bilevel optimization framework and propose the Bi-ZOL (Bilevel Zeroth-Order Learning) algorithm. Unlike conventional black-box methods, Bi-ZOL exploits the bilevel structure to decompose the hypergradient, integrating the exact analytical information of the SO's objective with a zeroth-order estimate of the unknown response sensitivity. This structural decomposition-based learning method mathematically smoothes the nonsmooth response landscape and reduces hypergradient estimation error. We provide theoretical convergence guarantees to an approximate stationary point and demonstrate through simulations that Bi-ZOL achieves near-optimal performance.

eess.SY↗

Load Management of Distribution Systems via Online Dynamic Pricing

The growing adoption of electric vehicles (EVs) is increasing peak demand in distribution systems, which can threaten grid stability and reduce operational efficiency. Dynamic electricity pricing is a promising means of mitigating these peaks by shifting flexible demand. However, most existing approaches rely on detailed user-level consumption data and behavioral models, which are often difficult to obtain in practice and may raise privacy concerns. This paper proposes an Online Feedback Optimization (OFO) algorithm for day-ahead price design with limited data, where only aggregate loads are observed. OFO updates prices iteratively using aggregate load measurements, enabling effective peak reduction without access to individual user data. The formulation also includes a term that penalizes deviations in total electricity cost relative to a reference tariff. Although relying only on aggregate load measurements, the OFO price updates efficiently converge to the optimal price. In finite-horizon simulations, OFO achieves peak reduction close to that of the Stackelberg benchmark with full model information. Meanwhile, its computational effort is substantially lower. Additional tests under multiple initial conditions and delayed charging-window mismatch further confirm the robustness of the proposed method. Overall, these results show that OFO is a scalable and computationally efficient approach for peak-demand management in distribution systems with limited observability.

eess.SY↗

Quantifying Grid-Forming Behavior: Bridging Device-Level Dynamics and System-Level Strength

Grid-forming (GFM) technology is widely regarded as a promising solution for future power systems dominated by power electronics. However, a precise method for quantifying GFM converter behavior and a universally accepted GFM definition remain elusive. Moreover, the impact of GFM on system stability is not precisely quantified, creating a significant disconnect between device and system levels. To address these gaps from a small-signal perspective, at the device level, we introduce a novel metric, the Forming Index (FI) to quantify a converter's response to grid voltage fluctuations. Rather than enumerating various control architectures, the FI provides a metric for the converter's GFM ability by quantifying its sensitivity to grid variations. At the system level, we propose a new quantitative measure of system strength that captures the multi-bus voltage stiffness, which quantifies the voltage and phase angle responses of multiple buses to current or power disturbances. We further extend and define this concept to grid strength and bus strength to identify weak areas within the system. Finally, we bridge the device and system levels by formally proving that GFM converters enhance system strength. Our proposed framework provides a unified benchmark for GFM converter design, optimal placement, and system stability assessment.

eess.SY↗

Towards Closed-loop Stability of Nonlinear Receding Horizon Games

We analyze Receding Horizon Games without any MPC-like terminal ingredients. We show that recursive feasibility can be inferred from the turnpike phenomenon under mild assumptions. Moreover, we prove sufficient conditions for practical asymptotic convergence of the closed-loop trajectories, and we discuss how the gap towards practical asymptotic stability may be closed. We use numerical examples to show that the closed-loop region of attraction around the steady-state GNE shrinks exponentially with the horizon length, a behavior previously known only for model predictive control. Further, we apply a linear end penalty and demonstrate in numerical simulations that it suppresses the leaving arc and ensures asymptotic convergence to the steady-state GNE.

eess.SY↗

Strategically Robust Aggregative Games

In many multiagent settings, such as electric vehicle charging and traffic routing, agents must make decisions in the face of uncertain behavior exhibited by others. Often, this uncertainty arises from multiple sources, such as incomplete information, limited computation, or bounded rationality, ultimately impacting the aggregate behavior. To tackle this challenge, we follow recent work on strategically robust game theory and postulate that agents seek protection directly against deviations around the emergent behavior, as opposed to explicitly modeling all sources of uncertainty. Specifically, we propose that each agent protects itself against the worst-case aggregate behavior within an optimal-transport-based ambiguity set centered at the emergent aggregate population behavior. This leads to a novel equilibrium concept, called strategically robust Wardrop equilibrium, that enables one to interpolate between standard Wardrop equilibria (no robustness) and security strategies (maximum robustness). In the setting of convex aggregative games, we establish the existence of a pure strategically robust Wardrop equilibrium and provide tractable computational tools for computing it. Through an application in electric vehicle charging, we demonstrate that strategically robust Wardrop equilibria lead to better decisions, protecting agents against the uncertain aggregate behavior of the population. Remarkably, we also observe that strategic robustness can lead to lower equilibrium costs for all agents, uncovering a "coordination-via-robustification" effect.

cs.GT↗