arXiv subjects

Florian Dörfler

Publications and source records attributed to Florian Dörfler.

At least 217 records · Page 12Linked to original sources

arXiv2021

Closing the Loop: Dynamic State Estimation and Feedback Optimization of Power Grids

This paper considers the problem of online feedback optimization to solve the AC Optimal Power Flow in real-time in power grids. This consists in continuously driving the controllable power injections and loads towards the optimal set-points in time-varying conditions based on real-time measurements performed on the grid. However, instead of assuming noise-free full state measurement like recent feedback optimization approaches, we connect a dynamic State Estimation using available measurements, and study its dynamic interaction with the optimization scheme. We certify stability of this interconnection and the convergence in expectation of the state estimate and the control inputs towards the true state values and optimal set-points respectively. Additionally, we bound the resulting stochastic error. Finally, we show the effectiveness of the approach on a test case using high resolution consumption data.

eess.SY↗

arXiv2021

Posetal Games: Efficiency, Existence, and Refinement of Equilibria in Games with Prioritized Metrics

Modern applications require robots to comply with multiple, often conflicting rules and to interact with the other agents. We present Posetal Games as a class of games in which each player expresses a preference over the outcomes via a partially ordered set of metrics. This allows one to combine hierarchical priorities of each player with the interactive nature of the environment. By contextualizing standard game theoretical notions, we provide two sufficient conditions on the preference of the players to prove existence of pure Nash Equilibria in finite action sets. Moreover, we define formal operations on the preference structures and link them to a refinement of the game solutions, showing how the set of equilibria can be systematically shrunk. The presented results are showcased in a driving game where autonomous vehicles select from a finite set of trajectories. The results demonstrate the interpretability of results in terms of minimum-rank-violation for each player.

cs.MA↗

arXiv2021

Game Theory to Study Interactions between Mobility Stakeholders

Increasing urbanization and exacerbation of sustainability goals threaten the operational efficiency of current transportation systems and confront cities with complex choices with huge impact on future generations. At the same time, the rise of private, profit-maximizing Mobility Service Providers leveraging public resources, such as ride-hailing companies, entangles current regulation schemes. This calls for tools to study such complex socio-technical problems. In this paper, we provide a game-theoretic framework to study interactions between stakeholders of the mobility ecosystem, modeling regulatory aspects such as taxes and public transport prices, as well as operational matters for Mobility Service Providers such as pricing strategy, fleet sizing, and vehicle design. Our framework is modular and can readily accommodate different types of Mobility Service Providers, actions of municipalities, and low-level models of customers choices in the mobility system. Through both an analytical and a numerical case study for the city of Berlin, Germany, we showcase the ability of our framework to compute equilibria of the problem, to study fundamental tradeoffs, and to inform stakeholders and policy makers on the effects of interventions. Among others, we show tradeoffs between customers satisfaction, environmental impact, and public revenue, as well as the impact of strategic decisions on these metrics.

cs.MA↗

arXiv2021

Distributional Gradient Matching for Learning Uncertain Neural Dynamics Models

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the adjoint method, many downstream tasks such as active learning, exploration in reinforcement learning, robust control, or filtering require accurate estimates of predictive uncertainties. In this work, we propose a novel approach towards estimating epistemically uncertain neural ODEs, avoiding the numerical integration bottleneck. Instead of modeling uncertainty in the ODE parameters, we directly model uncertainties in the state space. Our algorithm - distributional gradient matching (DGM) - jointly trains a smoother and a dynamics model and matches their gradients via minimizing a Wasserstein loss. Our experiments show that, compared to traditional approximate inference methods based on numerical integration, our approach is faster to train, faster at predicting previously unseen trajectories, and in the context of neural ODEs, significantly more accurate.

cs.LG↗

arXiv2021

System-Level Performance and Robustness of the Grid-Forming Hybrid Angle Control

This paper investigates the implementation and application of the multi-variable grid-forming hybrid angle control (HAC) for high-power converters in transmission grids. We explore the system-level performance and robustness of the HAC concept in contrast to other grid-forming schemes i.e., power-frequency droop and matching controls. Our findings suggest that similar to the ac-based droop control, \ac{hac} enhances the small-signal frequency stability in low-inertia power grids, and akin to the dc-based matching control, HAC exhibits robustness when accounting for the practical limits of the converter systems. Thus, HAC combines the aforementioned complementary advantages. Furthermore, we show how retuning certain control parameters of the grid-forming controls improve the frequency performance. Last, as separate contributions, we introduce an alternative control augmentation that enhances the robustness and provides theoretical guidelines on extending the stability certificates of \ac{hac} to multi-converter systems.

math.OC↗

arXiv2021

Sampled-Data Online Feedback Equilibrium Seeking: Stability and Tracking

This paper proposes a general framework for constructing feedback controllers that drive complex dynamical systems to "efficient" steady-state (or slowly varying) operating points. Efficiency is encoded using generalized equations which can model a broad spectrum of useful objectives, such as optimality or equilibria (e.g. Nash, Wardrop, etc.) in noncooperative games. The core idea of the proposed approach is to directly implement iterative solution (or equilibrium seeking) algorithms in closed loop with physical systems. Sufficient conditions for closed-loop stability and robustness are derived; these also serve as the first closed-loop stability results for sampled-data feedback-based optimization. Numerical simulations of smart building automation and game-theoretic robotic swarm coordination support the theoretical results.

math.OC↗

arXiv2021

On the Certainty-Equivalence Approach to Direct Data-Driven LQR Design

The linear quadratic regulator (LQR) problem is a cornerstone of automatic control, and it has been widely studied in the data-driven setting. The various data-driven approaches can be classified as indirect (i.e., based on an identified model) versus direct or as robust (i.e., taking uncertainty into account) versus certainty-equivalence. Here we show how to bridge these different formulations and propose a novel, direct, and regularized formulation. We start from indirect certainty-equivalence LQR, i.e., least-square identification of state-space matrices followed by a nominal model-based design, formalized as a bi-level program. We show how to transform this problem into a single-level, regularized, and direct data-driven control formulation, where the regularizer accounts for the least-square data fitting criterion. For this novel formulation we carry out a robustness and performance analysis in presence of noisy data. Our proposed direct and regularized formulation is also amenable to be further blended with a robust-stability-promoting regularizer. In a numerical case study we compare regularizers promoting either robustness or certainty-equivalence, and we demonstrate the remarkable performance when blending both of them.

math.OC↗

arXiv2021

Generalized Multivariable Grid-Forming Control Design for Power Converters

The grid-forming converter is an important unit in the future power system with more inverter-interfaced generators. However, improving its performance is still a key challenge. This paper proposes a generalized architecture of the grid-forming converter from the view of multivariable feedback control. As a result, many of the existing popular control strategies, i.e., droop control, power synchronization control, virtual synchronous generator control, matching control, dispatchable virtual oscillator control, and their improved forms are unified into a multivariable feedback control transfer matrix working on several linear and nonlinear error signals. Meanwhile, unlike the traditional assumptions of decoupling between AC and DC control, active power and reactive power control, the proposed configuration simultaneously takes all of them into consideration, which therefore can provide better performance. As an example, a new multi-input-multi-output-based grid-forming (MIMO-GFM) control is proposed based on the generalized configuration. To cope with the multivariable feedback, an optimal and structured $H_{\infty}$ synthesis is used to design the control parameters. At last, simulation and experimental results show superior performance and robustness of the proposed configuration and control.

eess.SY↗

arXiv2021

Bridging direct & indirect data-driven control formulations via regularizations and relaxations

We discuss connections between sequential system identification and control for linear time-invariant systems, often termed indirect data-driven control, as well as a contemporary direct data-driven control approach seeking an optimal decision compatible with recorded data assembled in a Hankel matrix and robustified through suitable regularizations. We formulate these two problems in the language of behavioral systems theory and parametric mathematical programs, and we bridge them through a multi-criteria formulation trading off system identification and control objectives. We illustrate our results with two methods from subspace identification and control: namely, subspace predictive control and low-rank approximation which constrain trajectories to be consistent with a non-parametric predictor derived from (respectively, the column span of) a data Hankel matrix. In both cases we conclude that direct and regularized data-driven control can be derived as convex relaxation of the indirect approach, and the regularizations account for an implicit identification step. Our analysis further reveals a novel regularizer and a plausible hypothesis explaining the remarkable empirical performance of direct methods on nonlinear systems.

math.OC↗

arXiv2021

Distributionally Robust Chance Constrained Data-enabled Predictive Control

We study the problem of finite-time constrained optimal control of unknown stochastic linear time-invariant systems, which is the key ingredient of a predictive control algorithm -- albeit typically having access to a model. We propose a novel distributionally robust data-enabled predictive control (DeePC) algorithm which uses noise-corrupted input/output data to predict future trajectories and compute optimal control inputs while satisfying output chance constraints. The algorithm is based on (i) a non-parametric representation of the subspace spanning the system behaviour, where past trajectories are sorted in Page or Hankel matrices; and (ii) a distributionally robust optimization formulation which gives rise to strong probabilistic performance guarantees. We show that for certain objective functions, DeePC exhibits strong out-of-sample performance, and at the same time respects constraints with high probability. The algorithm provides an end-to-end approach to control design for unknown stochastic linear time-invariant systems. We illustrate the closed-loop performance of the DeePC in an aerial robotics case study.

math.OC↗

arXiv2021

Dynamic Virtual Power Plant Design for Fast Frequency Reserves: Coordinating Hydro and Wind

To ensure frequency stability in future low-inertia power grids, fast ancillary services such as fast frequency reserves (FFR) have been proposed. In this work, the coordination of conventional (slow) frequency containment reserves (FCR) with FFR is treated as a decentralized model matching problem. The design results in a dynamic virtual power plant (DVPP) whose aggregated output fulfills the system operator (SO) requirements in all time scales, while accounting for the capacity and bandwidth limitation of participating devices. This is illustrated in a 5-machine representation of the Nordic synchronous grid. In the Nordic grid, stability issues and bandwidth limitations associated with non-minimum phase zeros of hydropower is a well-known problem. By simulating the disconnection of a 1400 MW importing dc link, it is shown that the proposed DVPP design allows for coordinating fast FFR from wind, with slow FCR from hydro, while respecting dynamic limitations of all participating devices. The SO requirements are fulfilled in a realistic low-inertia scenario without the need to install battery storage or to waste wind energy by curtailing the wind turbines.

eess.SY↗

arXiv2021

Decentralized Data-Enabled Predictive Control for Power System Oscillation Damping

We employ a novel data-enabled predictive control (DeePC) algorithm in voltage source converter (VSC) based high-voltage DC (HVDC) stations to perform safe and optimal wide-area control for power system oscillation damping. Conventional optimal wide-area control is model-based. However, in practice detailed and accurate parametric power system models are rarely available. In contrast, the DeePC algorithm uses only input/output data measured from the unknown system to predict the future trajectories and calculate the optimal control policy. We showcase that the DeePC algorithm can effectively attenuate inter-area oscillations even in the presence of measurement noise, communication delays, nonlinear loads and uncertain load fluctuations. We investigate the performance under different matrix structures as data-driven predictors. Furthermore, we derive a novel Min-Max DeePC algorithm to be applied independently in multiple VSC-HVDC stations to mitigate inter-area oscillations, which enables decentralized and robust optimal wide-area control. Further, we discuss how to relieve the computational burden of the Min-Max DeePC by reducing the dimension of prediction uncertainty and how to leverage disturbance feedback to reduce the conservativeness of robustification. We illustrate our results with high-fidelity, nonlinear, and noisy simulations of a four-area test system.

eess.SY↗

arXiv2021

Robust Data-Enabled Predictive Control: Tractable Formulations and Performance Guarantees

We introduce a general framework for robust data-enabled predictive control (DeePC) for linear time-invariant (LTI) systems. The proposed framework enables us to obtain model-free optimal control for LTI systems based on noisy input/output data. More specifically, robust DeePC solves a min-max optimization problem to compute the optimal control sequence that is resilient to all possible realizations of the uncertainties in the input/output data within a prescribed uncertainty set. We present computationally tractable reformulations of the min-max problem with various uncertainty sets. Furthermore, we show that even though an accurate prediction of the future behavior is unattainable in practice due to inaccessibility of the perfect input/output data, the obtained robust optimal control sequence provides performance guarantees for the actually realized input/output cost. We further show that the robust DeePC generalizes and robustifies the regularized DeePC (with quadratic regularization or 1-norm regularization) proposed in the literature. Finally, we demonstrate the performance of the proposed robust DeePC algorithm on high-fidelity, nonlinear, and noisy simulations of a grid-connected power converter system.

eess.SY↗

arXiv2021

Quadratic Regularization of Data-Enabled Predictive Control: Theory and Application to Power Converter Experiments

Data-driven control that circumvents the process of system identification by providing optimal control inputs directly from system data has attracted renewed attention in recent years. In this paper, we focus on understanding the effects of the regularization on the data-enabled predictive control (DeePC) algorithm. We provide theoretical motivation and interpretation for including a quadratic regularization term. Our analysis shows that the quadratic regularization term leads to robust and optimal solutions with regards to disturbances affecting the data. Moreover, when the input/output constraints are inactive, the quadratic regularization leads to a closed-form solution of the DeePC algorithm and thus enables fast calculations. On this basis, we propose a framework for data-driven synchronization and power regulations of power converters, which is tested by high-fidelity simulations and experiments.

eess.SY↗

arXiv2021

A Lyapunov framework for nested dynamical systems on multiple time scales with application to converter-based power systems

In this work, we present a Lyapunov framework for establishing stability with respect to a compact set for a nested interconnection of nonlinear dynamical systems ordered from slow to fast according to their convergence rates, where each of the dynamics are influenced only by the slower dynamics and the successive fastest one. The proposed approach explicitly considers more than two time scales, it does not require modeling multiple time scales via scalar time constants, and provides analytic bounds that make ad-hoc time-scale separation arguments rigorous. Motivated by the technical results, we develop a novel control strategy for a grid-forming power converter that consists of an inner cascaded two-degree of freedom controller and dispatchable virtual oscillator control as a reference model. The resulting closed-loop converter-based AC power system is in the form of a nested system with multiple time scales. We apply our technical results to obtain explicit bounds on the controller set-points, branch powers, and control gains that guarantee almost global asymptotic stability of the multi-converter AC power system with respect to a pre-specified solution of the AC power-flow equations. Finally, we validate the performance of the proposed control structure in a case study using a high-fidelity simulation with detailed hardware validated converter models.

math.OC↗

arXiv2020

Structural Balance and Interpersonal Appraisals Dynamics: Beyond All-to-All and Two-Faction Networks

Structural balance theory describes stable configurations of topologies of signed interpersonal appraisal networks. Existing models explaining the convergence of appraisal networks to structural balance either diverge in finite time, or could get stuck in jammed states, or converge to only complete graphs. In this paper, we study the open problem how steady non-all-to-all structural balance emerges via local dynamics of interpersonal appraisals. We first compare two well-justified definitions of structural balance for general non-all-to-all graphs, i.e., the triad-wise structural balance and the two-faction structural balance, and thoroughly study their relations. Secondly, based on three widely adopted sociological mechanisms: the symmetry mechanism, the influence mechanism, and the homophily mechanism, we propose two simple models of gossip-like appraisal dynamics, the symmetry-influence-homophily (SIH) dynamics and the symmetry-influence-opinion-homophily (SIOH) dynamics. In these models, the appraisal network starting from any initial condition almost surely achieves non-all-to-all triad-wise and two-faction structural balance in finite time respectively. Moreover, the SIOH dynamics capture the co-evolution of interpersonal appraisals and individuals' opinions. Regarding the theoretical contributions, we show that the equilibrium set of the SIH (SIOH resp.) dynamics corresponds to the set of all the possible triad-wise (two-faction resp.) structural balance configurations of the appraisal networks. Moreover, we prove that, for any initial condition, the appraisal networks in the SIH (SIOH resp.) dynamics almost surely achieve triad-wise (two-faction resp.) structural balance in finite time. Numerical studies of the SIH dynamics also imply some insightful take-home messages on whether multilateral relations reduce or exacerbate conflicts.

cs.SI↗

arXiv2020

Parametric local stability condition of a multi-converter system

We study local (also referred to as small-signal) stability of a network of identical DC/AC converters having a rotating degree of freedom. We develop a stability theory for a class of partitioned linear systems with symmetries that has natural links to classical stability theories of interconnected systems. We find stability conditions descending from a particular Lyapunov function involving an oblique projection onto the complement of the synchronous steady state set and enjoying insightful structural properties. Our sufficient and explicit stability conditions can be evaluated in a fully decentralized fashion, reflect a parametric dependence on the converter's steady-state variables, and can be one-to-one generalized to other types of systems exhibiting the same behavior, such as synchronous machines. Our conditions demand for sufficient reactive power support and resistive damping. These requirements are well aligned with practitioners' insights.

math.OC↗

arXiv2020

Limit Behavior and the Role of Augmentation in Projected Saddle Flows for Convex Optimization

In this paper, we study the stability and convergence of continuous-time Lagrangian saddle flows to solutions of a convex constrained optimization problem. Convergence of these flows is well-known when the underlying saddle function is either strictly convex in the primal or strictly concave in the dual variables. In this paper, we show convergence under non-strict convexity when a simple, unilateral augmentation term is added. For this purpose, we establish a novel, non-trivial characterization of the limit set of saddle-flow trajectories that allows us to preclude limit cycles. With our presentation we try to unify several existing problem formulations as a projected dynamical system that allows projection of both the primal and dual variables, thus complementing results available in the recent literature.

math.OC↗