arXiv subjects

Florian Dörfler

Publications and source records attributed to Florian Dörfler.

At least 181 records · Page 10Linked to original sources

arXiv2023

Distributed State Estimation for Linear Time-Varying Systems with Sensor Network Delays

Distributed sensor networks often include a multitude of sensors, each measuring parts of a process state space or observing the operations of a system. Communication of measurements between the sensor nodes and estimator(s) cannot realistically be considered delay-free due to communication errors and transmission latency in the channels. We propose a novel stability-based method that mitigates the influence of sensor network delays in distributed state estimation for linear time-varying systems. Our proposed algorithm efficiently selects a subset of sensors from the entire sensor nodes in the network based on the desired stability margins of the distributed Kalman filter estimates, after which, the state estimates are computed only using the measurements of the selected sensors. We provide comparisons between the estimation performance of our proposed algorithm and a greedy algorithm that exhaustively selects an optimal subset of nodes. We then apply our method to a simulative scenario for estimating the states of a linear time-varying system using a sensor network including 2000 sensor nodes. Simulation results demonstrate the performance efficiency of our algorithm and show that it closely follows the achieved performance by the optimal greedy search algorithm.

eess.SY↗

arXiv2023

Designing Optimal Personalized Incentive for Traffic Routing using BIG Hype algorithm

We study the problem of optimally routing plug-in electric and conventional fuel vehicles on a city level. In our model, commuters selfishly aim to minimize a local cost that combines travel time, from a fixed origin to a desired destination, and the monetary cost of using city facilities, parking or service stations. The traffic authority can influence the commuters' preferred routing choice by means of personalized discounts on parking tickets and on the energy price at service stations. We formalize the problem of designing these monetary incentives optimally as a large-scale bilevel game, where constraints arise at both levels due to the finite capacities of city facilities and incentives budget. Then, we develop an efficient decentralized solution scheme with convergence guarantees based on BIG Hype, a recently-proposed hypergradient-based algorithm for hierarchical games. Finally, we validate our model via numerical simulations over the Anaheim's network, and show that the proposed approach produces sensible results in terms of traffic decongestion and it is able to solve in minutes problems with more than 48000 variables and 110000 constraints.

math.OC↗

arXiv2023

Wasserstein Tube MPC with Exact Uncertainty Propagation

We study model predictive control (MPC) problems for stochastic LTI systems, where the noise distribution is unknown, compactly supported, and only observable through a limited number of i.i.d. noise samples. Building upon recent results in the literature, which show that distributional uncertainty can be efficiently captured within a Wasserstein ambiguity set, and that such ambiguity sets propagate exactly through the system dynamics, we start by formulating a novel Wasserstein Tube MPC (WT-MPC) problem, with distributionally robust CVaR constraints. We then show that the WT-MPC problem: (1) is a direct generalization of the (deterministic) Robust Tube MPC (RT-MPC) to the stochastic setting; (2) through a scalar parameter, it interpolates between the data-driven formulation based on sample average approximation and the RT-MPC formulation, allowing us to optimally trade between safety and performance; (3) admits a tractable convex reformulation; and (4) is recursively feasible. We conclude the paper with a numerical comparison of WT-MPC and RT-MPC.

math.OC↗

arXiv2023

Real-time Curative Actions for Power Systems via Online Feedback Optimization

Curative or remedial actions are the set of immediate actions intended to bring the power grid to a safe operating point after a contingency. The effectiveness of these actions is essential to guarantee curative N-1 security. Nowadays, curative actions are derived ahead of time, based on the anticipated future grid state. Due to the shift from steady to volatile energy resources, the grid state will frequently change and the curative actions would need to be pre-planned increasingly often. Furthermore, with the shift from large bulk production to many small decentralized energy sources more devices need to be actuated simultaneously to achieve the same outcome. Instead of pre-planning, we propose to calculate these complex curative actions in real-time after the occurrence of a contingency. We show how the method of Online Feedback Optimization (OFO) is well suited for this task. As a preliminary demonstration of these capabilities, we use an (OFO) controller, that after a fault, reduces the voltage difference over a breaker to enable the operators to reclose it. This test case is inspired by the 2003 Swiss-Italian blackout, which was caused by a relatively minor incident followed by ineffective curative actions. Finally, we identify and discuss some open questions, including closed-loop stability and robustness to model mismatch.

eess.SY↗

arXiv2023

Stochastic Wasserstein Gradient Flows using Streaming Data with an Application in Predictive Maintenance

We study estimation problems in safety-critical applications with streaming data. Since estimation problems can be posed as optimization problems in the probability space, we devise a stochastic projected Wasserstein gradient flow that keeps track of the belief of the estimated quantity and can consume samples from online data. We show the convergence properties of our algorithm. Our analysis combines recent advances in the Wasserstein space and its differential structure with more classical stochastic gradient descent. We apply our methodology for predictive maintenance of safety-critical processes: Our approach is shown to lead to superior performance when compared to classical least squares, enabling, among others, improved robustness for decision-making.

eess.SY↗

arXiv2023

Capture, Propagate, and Control Distributional Uncertainty

We study stochastic dynamical systems in settings where only partial statistical information about the noise is available, e.g., in the form of a limited number of noise realizations. Such systems are particularly challenging to analyze and control, primarily due to an absence of a distributional uncertainty model which: (1) is expressive enough to capture practically relevant scenarios; (2) can be easily propagated through system maps; (3) is invariant under propagation; and (4) allows for computationally tractable control actions. In this paper, we propose to model distributional uncertainty via Optimal Transport ambiguity sets and show that such modeling choice satisfies all of the above requirements. We then specialize our results to stochastic LTI systems, and start by showing that the distributional uncertainty can be efficiently captured, with high probability, within an Optimal Transport ambiguity set on the space of noise trajectories. Then, we show that such ambiguity sets propagate exactly through the system dynamics, giving rise to stochastic tubes that contain, with high probability, all trajectories of the stochastic system. Finally, we show that the control task is very interpretable, unveiling an interesting decomposition between the roles of the feedforward and the feedback control terms. Our results are actionable and successfully applied in stochastic reachability analysis and in trajectory planning under distributional uncertainty.

math.OC↗

arXiv2023

Stability and Robustness of Distributed Suboptimal Model Predictive Control

In distributed model predictive control (MPC), the control input at each sampling time is computed by solving a large-scale optimal control problem (OCP) over a finite horizon using distributed algorithms. Typically, such algorithms require several (virtually, infinite) communication rounds between the subsystems to converge, which is a major drawback both computationally and from an energetic perspective (for wireless systems). Motivated by these challenges, we propose a suboptimal distributed MPC scheme in which the total communication burden is distributed also in time, by maintaining a running solution estimate for the large-scale OCP and updating it at each sampling time. We demonstrate that, under some regularity conditions, the resulting suboptimal MPC control law recovers the qualitative robust stability properties of optimal MPC, if the communication budget at each sampling time is large enough.

eess.SY↗

arXiv2023

A quantitative and constructive proof of Willems' Fundamental Lemma and its implications

Willems' Fundamental Lemma provides a powerful data-driven parametrization of all trajectories of a controllable linear time-invariant system based on one trajectory with persistently exciting (PE) input. In this paper, we present a novel proof of this result which is inspired by the classical adaptive control literature and differs from existing proofs in multiple aspects. The proof involves a quantitative and directional PE notion, allowing to characterize robust PE properties via singular value bounds, as opposed to binary rank-based PE conditions. Further, the proof is constructive, i.e., we derive an explicit PE lower bound for the generated data. As a contribution of independent interest, we generalize existing PE results from the adaptive control literature and reveal a crucial role of the system's zeros.

math.OC↗

arXiv2023

Designing Fairness in Autonomous Peer-to-peer Energy Trading

Several autonomous energy management and peer-to-peer trading mechanisms for future energy markets have been recently proposed based on optimization and game theory. In this paper, we study the impact of trading prices on the outcome of these market designs for energy-hub networks. We prove that, for a generic choice of trading prices, autonomous peer-to-peer trading is always network-wide beneficial but not necessarily individually beneficial for each hub. Therefore, we leverage hierarchical game theory to formalize the problem of designing locally-beneficial and network-wide fair peer-to-peer trading prices. Then, we propose a scalable and privacy-preserving price-mediation algorithm that provably converges to a profile of such prices. Numerical simulations on a 3-hub network show that the proposed algorithm can indeed incentivize active participation of energy hubs in autonomous peer-to-peer trading schemes.

eess.SY↗

arXiv2023

Nonlinear Stability of Complex Droop Control in Converter-Based Power Systems

In this letter, we study the nonlinear stability problem of converter-based power systems, where the converter dynamics are governed by a complex droop control. This complex droop control augments the well-known power-frequency (p-f) droop control, and it proves to be equivalent to the state-of-the-art dispatchable virtual oscillator control (dVOC). In this regard, it is recognized as a promising grid-forming solution to address the high penetration of converters in future power systems. In previous work, the global stability of dVOC (i.e., complex droop control) has been proven by prespecifying a nominal synchronous steady state. For a general case of non-nominal (i.e., drooped) synchronous steady states, however, the stability problem requires further investigation. In this letter, we provide parametric conditions under which a non-nominal synchronous steady state exists and the system is almost globally asymptotically stable with respect to this non-nominal synchronous steady state.

eess.SY↗

arXiv2022

Rethinking the Micro-Foundation of Opinion Dynamics: Rich Consequences of the Weighted-Median Mechanism

To identify the main mechanisms underlying complex opinion formation processes in social systems, researchers have long been exploring simple mechanistic mathematical models. Most existing opinion dynamics models are built on a common micro-foundation, i.e., the weighted-averaging opinion update. However, we argue that this universally-adopted mechanism features a non-negligible unrealistic feature, which brings unnecessary difficulties in seeking a proper balance between model complexity and predictive power. In this paper, we propose the weighted-median mechanism as a new micro-foundation of opinion dynamics, which, with minimal assumptions, fundamentally resolves the inherent unrealistic feature of the weighted-averaging mechanism. Derived from the cognitive dissonance theory in psychology, the weighted-median mechanism is supported by online experiment data and broadens the applicability of opinion dynamics models to multiple-choice issues with ordered discrete options. Moreover, the weighted-median mechanism, despite being the simplest in form, captures various non-trivial real-world features of opinion evolution, while some widely-studied averaging-based models fail to.

cs.SI↗

arXiv2022

Convergence, Consensus and Dissensus in the Weighted-Median Opinion Dynamics

Mechanistic and tractable mathematical models play a key role in understanding how social influence shapes public opinions. Recently, a weighted-median mechanism has been proposed as a new micro-foundation of opinion dynamics and validated via experimental data. Numerical studies also indicate that this new mechanism recreates some non-trivial real-world features of opinion evolution. In this paper, we conduct a thorough theoretical analysis of the weighted-median opinion dynamics. We fully characterize the set of all equilibria, and we establish the almost-sure finite-time convergence for any initial condition. Moreover, we prove a necessary and sufficient graph-theoretic condition for the almost-sure convergence to consensus, as well as a sufficient graph-theoretic condition for almost-sure persistent dissensus. It turns out that the weighted-median opinion dynamics, despite its simplicity in form, exhibit rich dynamical behavior that depends on some delicate network structures. To complement our sufficient conditions for almost-sure dissensus, we further prove that, given the influence network, determining whether the system almost surely achieves persistent dissensus is NP-hard, which reflects the complexity the network topology contributes to opinion evolution.

eess.SY↗

arXiv2022

Minimal regret state estimation of time-varying systems

Kalman and H-infinity filters, the most popular paradigms for linear state estimation, are designed for very specific specific noise and disturbance patterns, which may not appear in practice. State observers based on the minimization of regret measures are a promising alternative, as they aim to adapt to recognizable patterns in the estimation error. In this paper, we show that the regret minimization problem for finite horizon estimation can be cast into a simple convex optimization problem. For this purpose, we first rewrite linear time-varying system dynamics using a novel system level synthesis parametrization for state estimation, capable of handling both disturbance and measurement noise. We then provide a tractable formulation for the minimization of regret based on semi-definite programming. Both contributions make the minimal regret observer design easily implementable in practice. Finally, numerical experiments show that the computed observer can significantly outperform both H-2 and H-infinity filters.

eess.SY↗

arXiv2022

Safe Control with Minimal Regret

As we move towards safety-critical cyber-physical systems that operate in non-stationary and uncertain environments, it becomes crucial to close the gap between classical optimal control algorithms and adaptive learning-based methods. In this paper, we present an efficient optimization-based approach for computing a finite-horizon robustly safe control policy that minimizes dynamic regret, in the sense of the loss relative to the optimal sequence of control actions selected in hindsight by a clairvoyant controller. By leveraging the system level synthesis framework (SLS), our method extends recent results on regret minimization for the linear quadratic regulator to optimal control subject to hard safety constraints, and allows competing against a safety-aware clairvoyant policy with minor modifications. Numerical experiments confirm superior performance with respect to finite-horizon constrained $\mathcal{H}_2$ and $\mathcal{H}_\infty$ control laws when the disturbance realizations poorly fit classical assumptions.

eess.SY↗

arXiv2022

Follow the Clairvoyant: an Imitation Learning Approach to Optimal Control

We consider control of dynamical systems through the lens of competitive analysis. Most prior work in this area focuses on minimizing regret, that is, the loss relative to an ideal clairvoyant policy that has noncausal access to past, present, and future disturbances. Motivated by the observation that the optimal cost only provides coarse information about the ideal closed-loop behavior, we instead propose directly minimizing the tracking error relative to the optimal trajectories in hindsight, i.e., imitating the clairvoyant policy. By embracing a system level perspective, we present an efficient optimization-based approach for computing follow-the-clairvoyant (FTC) safe controllers. We prove that these attain minimal regret if no constraints are imposed on the noncausal benchmark. In addition, we present numerical experiments to show that our policy retains the hallmark of competitive algorithms of interpolating between classical $\mathcal{H}_2$ and $\mathcal{H}_\infty$ control laws - while consistently outperforming regret minimization methods in constrained scenarios thanks to the superior ability to chase the clairvoyant.

eess.SY↗

arXiv2022

Real-time Projected Gradient-based Nonlinear Model Predictive Control with an Application to Anesthesia Control

Medical drug infusion problems pose a combination of challenges such as nonlinearities from physiological models, model uncertainty due to inter- and intra-patient variability, as well as strict safety specifications. With these challenges in mind, we propose a novel real-time Nonlinear Model Predictive Control (NMPC) scheme based on projected gradient descent iterations. At each iteration, a small number of steps along the gradient of the NMPC cost is taken, generating a suboptimal input which asymptotically converges to the optimal input. We retrieve classical Lyapunov stability guarantees by performing a sufficient number of gradient iterations until fulfilling a stopping criteria. Such a real-time control approach allows for higher sampling rates and faster feedback from the system which is advantageous for the class of highly variable and uncertain drug infusion problems. To demonstrate the controller's potential, we apply it to hypnosis control in anesthesia of two interacting drugs. The controller successfully regulates hypnosis even under disturbances and uncertainty and fulfils benchmark performance criteria.

eess.SY↗

arXiv2022

Distributed and Constrained $ \mathcal{H}_2 $ Control Design via System Level Synthesis and Dual Consensus ADMM

Design of optimal distributed linear feedback controllers to achieve a desired aggregate behavior, while simultaneously satisfying state and input constraints, is a challenging but important problem in many applications. System level synthesis is a recent technique which has been used to reparametrize the optimal control problem as a convex program. Prior work on system level synthesis with state and input constraints has included closed-loop finite impulse response and locality constraints or, in the case where these constraints were lifted using a simple pole approximation, only a centralized design was considered. However, closed-loop finite impulse response and locality constraints cannot be satisfied in many applications. Furthermore, the centralized design using the simple pole approximation lacks robustness to communication failures and disturbances, has high computational cost and does not preserve data privacy of local controllers. The main contribution of this work is to develop a distributed solution to system level synthesis with the simple pole approximation in order to incorporate state and input constraints without closed-loop finite impulse response or locality constraints, and in a distributed implementation. To achieve this, it is first shown that the dual of this problem is a distributed consensus problem. Then, an algorithm is developed based on the alternating direction method of multipliers to solve the dual while recovering a primal solution, and a convergence certificate is provided. Finally, the method's performance is demonstrated on a test case of control design for distributed energy resources that collectively provide stability services to the power grid.

math.OC↗

arXiv2022

Trust Region Policy Optimization with Optimal Transport Discrepancies: Duality and Algorithm for Continuous Actions

Policy Optimization (PO) algorithms have been proven particularly suited to handle the high-dimensionality of real-world continuous control tasks. In this context, Trust Region Policy Optimization methods represent a popular approach to stabilize the policy updates. These usually rely on the Kullback-Leibler (KL) divergence to limit the change in the policy. The Wasserstein distance represents a natural alternative, in place of the KL divergence, to define trust regions or to regularize the objective function. However, state-of-the-art works either resort to its approximations or do not provide an algorithm for continuous state-action spaces, reducing the applicability of the method. In this paper, we explore optimal transport discrepancies (which include the Wasserstein distance) to define trust regions, and we propose a novel algorithm - Optimal Transport Trust Region Policy Optimization (OT-TRPO) - for continuous state-action spaces. We circumvent the infinite-dimensional optimization problem for PO by providing a one-dimensional dual reformulation for which strong duality holds. We then analytically derive the optimal policy update given the solution of the dual problem. This way, we bypass the computation of optimal transport costs and of optimal transport maps, which we implicitly characterize by solving the dual formulation. Finally, we provide an experimental evaluation of our approach across various control tasks. Our results show that optimal transport discrepancies can offer an advantage over state-of-the-art approaches.

cs.LG↗