arXiv Science⌕ Search

arXiv subjects

Mario di Bernardo

Publications and source records attributed to Mario di Bernardo.

At least 19 recordsLinked to original sources

Entropy-Regularized Optimal Transport for Time-Varying Multi-Agent Coverage Control

This paper addresses time-varying coverage control for multi-agent systems, formulated as the tracking of an evolving target density via entropy-regularized semi-discrete optimal transport. Unlike the hard Laguerre partition of the unregularized formulation, entropic regularization assigns fractions of the mass at each point to all agents, simplifying the design and numerical implementation of the control law. We derive a feedback-feedforward controller that tracks the evolving first-order optimality conditions with exponential convergence, and we investigate the role of the regularization parameter, which, above a critical threshold, renders the fully collapsed configuration locally optimal. Numerical experiments validate the theory: for moderate regularization, the proposed approach has performance comparable to the unregularized formulation and outperforms the corresponding Voronoi-based coverage baseline.

eess.SY↗

Semi-discrete Optimal Transport for Time-Varying Multi-Agent Coverage Control

Coverage control algorithms have traditionally focused on static target densities, where agents optimally cover a fixed spatial distribution. However, many applications, such as environmental monitoring, surveillance, and adaptive sensing, involve time-varying densities. While time-varying coverage has been studied in Voronoi-based frameworks, extending recent optimal transport formulations of static coverage control to time-varying target densities remains an open problem. This paper presents a semi-discrete optimal transport framework for time-varying coverage control, in which agents track the first-order optimality conditions associated with minimizing the instantaneous Wasserstein distance from an evolving target density. The proposed approach is based on a coupled system of differential equations governing agent positions and the dual variables defining Laguerre regions. The resulting optimality residuals converge exponentially to zero, with global convergence established for one-dimensional domains. We also derive decentralized approximations and numerical simulations demonstrate improved tracking performance over quasi-static and Voronoi-based methods.

eess.SY↗

Synchronization of directed hypergraphs with heterogeneities via dynamic coupling

Many real-world networks involve interactions among three or more agents that cannot be reduced to pairwise coupling, making hypergraphs a natural modeling framework. In this work, we study complete synchronization in directed hypergraphs of nonlinear agents with parameter mismatches under dynamic diffusive coupling. Although proportional-integral coupling schemes are known to achieve consensus in heterogeneous linear networks, their ability to enforce complete synchronization in nonlinear systems is more limited, generally yielding only bounded synchronization. We show that complete synchronization can be attained only when the effect of parameter mismatches is structurally equivalent, in the transverse dynamics, to a constant disturbance. Under this condition, we derive invariance and local stability conditions for the synchronization manifold and develop a Master Stability Function framework for directed hypergraphs with dynamic coupling. The proposed approach accounts for distinct proportional and integral hypergraph layers and provides spectral criteria for predicting synchronization regions. Numerical simulations on directed hypergraphs of Lorenz oscillators validate the theoretical predictions and show how the integral action can compensate destabilizing effects induced by the proportional layer. We further demonstrate the applicability of the framework to a pinning-control problem in nonlinear opinion dynamics, where dynamic diffusive coupling achieves complete leader-follower consensus in the presence of heterogeneity.

eess.SY↗

Multi-Scale Control of Large Agent Populations: From Density Dynamics to Individual Actuation

We review a body of recent work by the author and collaborators on controlling the spatial organisation of large agent populations across multiple scales. A central theme is the systematic bridging of microscopic agent-level dynamics and macroscopic density descriptions, enabling control design at the most natural level of abstraction and subsequent translation across scales. We show how this multi-scale perspective provides a unified approach to both \emph{direct control}, where every agent is actuated, and \emph{indirect control}, where few leaders or herders steer a larger uncontrolled population. The review covers continuification-based control with robustness under limited sensing and decentralised implementation via distributed density estimation; leader--follower density regulation with dual-feedback stability guarantees and bio-inspired plasticity; optimal-transport methods for coverage control and macro-to-micro discretisation; nonreciprocal field theory for collective decision-making; mean-field control barrier functions for population-level safety; and hierarchical reinforcement learning for settings where closed-form solutions are intractable. Together, these results demonstrate the breadth and versatility of a multi-scale control framework that integrates analytical methods, learning, and physics-inspired approaches for large agent populations.

eess.SY↗

Feedback Control of a Recirculating Bioreactor with Electrophoretic Removal of Inhibitory Extracellular DNA

Extracellular DNA accumulation in recirculating bioprocesses inhibits microbial growth and reduces productivity. We consider a continuous bioreactor with a recirculating loop and an electrophoretic filtration unit for selective DNA removal, and develop a feedback control framework combining online state and parameter estimation via an Unscented Kalman Filter with an adaptive Model Predictive Controller that jointly optimizes dilution rate and filtration activation. Closed-loop simulations under nominal and perturbed conditions show that the addition of the filtration unit enables the proposed control strategy to achieve significantly higher cumulative profit while keeping DNA concentration below the inhibition threshold.

eess.SY↗

Sparse shepherding control of large-scale multi-agent systems via Reinforcement Learning

We propose a Reinforcement Learning framework for sparse indirect control of large-scale multi-agent systems, where few controlled agents shape the collective behavior of many uncontrolled agents. The approach addresses this multi-scale challenge by coupling ODEs (modeling controlled agents) with a PDE (describing the uncontrolled population density), capturing how microscopic control achieves macroscopic objectives. Our method combines model-free Reinforcement Learning with adaptive interaction strength compensation to overcome sparse actuation limitations. Numerical validation demonstrates effective density control, with the system achieving target distributions while maintaining robustness to disturbances and measurement noise, confirming that learning-based sparse control can replace computationally expensive online optimization.

eess.SY↗

Multi-robot obstacle-aware shepherding of non-cohesive target agents

This paper presents a novel control strategy for multi-agent shepherding of non-cohesive targets in obstacle-rich environments. Unlike previous approaches that assume cohesive flocking behavior, our method handles targets that interact only with nearby herders through repulsive forces and exhibit no inter-target coordination. Each herder employs a hybrid control policy that combines direct goal-oriented steering with obstacle-tangent maneuvering, enabling targets to circumnavigate obstacles while being guided toward a goal region. The herder dynamics integrate three key behaviors: return-to-goal motion when idle, target steering with adaptive directional control, and obstacle avoidance using both normal and tangential force components. Numerical simulations demonstrate superior performance compared to existing shepherding methods, achieving higher target confinement rates in cluttered environments. Experimental validation using TurtleBot4 herders and Osoyoo target robots in an indoor arena confirms the practical effectiveness of the proposed approach.

eess.SY↗

Leader-Follower Density Control of Multi-Agent Systems with Interacting Followers: Feasibility and Convergence Analysis

We address density control problems for large-scale multi-agent systems in leader-follower settings, where a group of controllable leaders must steer a population of followers toward a desired spatial distribution. Unlike prior work, we explicitly account for follower-follower interactions, capturing realistic behaviors such as flocking and collision avoidance. Within a macroscopic framework based on partial differential equations governing the density dynamics, we derive (i) necessary and sufficient feasibility conditions linking the target distribution to interaction strength, diffusion, and leader mass, and (ii) a feedback control law guaranteeing local stability with an explicit estimate of the basin of attraction. Our analysis reveals sharp feasibility thresholds, phase transitions beyond which no control effort can achieve the desired configuration. Numerical simulations in one- and two-dimensional domains validate the theoretical results at the macroscopic level, and agent-based simulations on finite populations confirm the practical deployability of the proposed framework.

eess.SY↗

Complex-Valued Kuramoto Networks: A Unified Control-Theoretic Framework

Synchronization in networks of coupled oscillators is classically studied via the Kuramoto model, whose intrinsic nonlinearity limits analytical tractability and complicates control design. Complex-valued extensions circumvent this by embedding phase dynamics into a higher-dimensional linear state space, where regulating complex-state moduli to a common value recovers Kuramoto phase behavior. Existing approaches to address this problem correspond, within a unified control framework, to state-feedback and hybrid reset-based strategies, each with performance constraints. We propose two switched control designs that overcome these limitations: a switched feedforward law ensuring exact phase correspondence at all times, and a feedforward plus sliding-mode law achieving finite-time convergence without spectral gain tuning. Additionally, we present a non-autonomous complex-valued MIMO sliding-mode controller that enforces phase locking at a prescribed frequency in finite time, independent of natural frequencies and coupling strengths. Simulations confirm improved transient response, steady-state accuracy, and robustness, including synchronization of heterogeneous networks where the classical real-valued Kuramoto model fails.

eess.SY↗

Mean-field control barrier functions for stochastic multi-agent systems

Many applications involving multi-agent systems require fulfilling safety constraints. Control barrier functions offer a systematic framework to enforce forward invariance of safety sets. Recent work extended this paradigm to mean-field scenarios, where the number of agents is large enough to make density-space descriptions a reasonable workaround for the curse of dimensionality. However, an open gap in the recent literature concerns the development of mean-field control barrier functions for Fokker-Planck (advection-diffusion) equations. In this work, we address this gap, enabling safe mean-field control of agents with stochastic microscopic dynamics. We provide bounded stability guarantees under safety corrections and corroborate our results through numerical simulations in two representative scenarios, coverage and shepherding control of multi-agent systems.

eess.SY↗

ROPE: A Novel Method for Real-Time Phase Estimation of Complex Biological Rhythms

Accurate phase estimation -- the process of assigning phase values between $0$ and $2π$ to repetitive or periodic signals -- is a cornerstone in the analysis of oscillatory signals across diverse fields, from neuroscience to robotics, where it is fundamental, e.g., to understanding coordination in neural networks, cardiorespiratory coupling, and human-robot interaction. However, existing methods are often limited to offline processing and/or constrained to one-dimensional signals. In this paper, we introduce ROPE, which, to the best of our knowledge, is the first phase-estimation algorithm capable of (i) handling signals of arbitrary dimension and (ii) operating in real-time, with minimal error. ROPE identifies repetitions within the signal to segment it into (pseudo-)periods and assigns phase values by performing efficient, tractable searches over previous signal segments. We extensively validate the algorithm on a variety of signal types, including trajectories from chaotic dynamical systems, human motion-capture data, and electrocardiographic recordings. Our results demonstrate that ROPE is robust against noise and signal drift, and achieves significantly superior performance compared to state-of-the-art phase estimation methods. This advancement enables real-time analysis of complex biological rhythms, opening new pathways, for example, for early diagnosis of pathological rhythm disruptions and developing rhythm-based therapeutic interventions in neurological and cardiovascular disorders.

eess.SP↗

Robust multi-scale leader-follower control of large multi-agent systems

In many multi-agent systems of practical interest, such as traffic networks or crowd evacuation, control actions cannot be exerted on all agents. Instead, controllable leaders must indirectly steer uncontrolled followers through local interactions. Existing results address either leader-follower density control of simple, unperturbed multi-agent systems or robust density control of a single directly actuated population, but not their combination. We bridge this gap by deriving a coupled continuum description for leaders and followers subject to unknown bounded perturbations, and designing a macroscopic feedback law that guarantees global asymptotic convergence of the followers' density to a desired distribution. The coupled stability of the leader-follower system is analyzed via singular perturbation theory, and an explicit lower bound on the leader-to-follower mass ratio required for feasibility is derived. Numerical simulations on heterogeneous biased random walkers validate our theoretical findings.

eess.SY↗

Multicellular Feedback Control Strategies in Synthetic Microbial Consortia: From Embedded to Distributed Control

Living organisms rely on endogenous feedback mechanisms to maintain homeostasis in the presence of uncertainty and environmental fluctuations. An emerging challenge at the interface of control systems engineering and synthetic biology is the design of reliable feedback strategies to regulate cellular behavior and collective biological functions. In this article, we review recent advances in multicellular feedback control, where sensing, computation, and actuation are distributed across different cell populations within synthetic microbial consortia, giving rise to biological multiagent control systems governed by molecular communication. From a control-theoretic perspective, these consortia can be interpreted as distributed biomolecular control systems, where coordination among populations replace embedded regulation. We survey theoretical frameworks, control architectures, and modeling approaches, ranging from aggregate population-level dynamics to spatially aware agent-based simulations, and discuss experimental demonstrations in engineered \textit{Escherichia coli} consortia. We highlight how distributing control functions across populations can reduce metabolic burden, mitigate retroactivity, improve robustness to uncertainty, and enable modular reuse of control components. Beyond regulation of gene expression, we discuss the emerging problem of population composition control, where coordination among growing and competing cell populations becomes an integral part of the control objective. Finally, we outline key open challenges that must be addressed before multicellular control strategies can be deployed in real-world applications such as biomanufacturing, environmental remediation, and therapeutic systems. These challenges span modeling and simulation, experimental platform development, coordination and composition control, and long-term evolutionary stability.

eess.SY↗

Robust Macroscopic Density Control of Heterogeneous Multi-Agent Systems

Modern applications, such as orchestrating the collective behavior of robotic swarms or traffic flows, require the coordination of large groups of agents evolving in unstructured environments, where disturbances and unmodeled dynamics are unavoidable. In this work, we develop a scalable macroscopic density control framework in which a feedback law is designed directly at the level of an advection--diffusion partial differential equation. We formulate the control problem in the density space and prove global exponential convergence towards the desired behavior in $\mathcal{L}^2$ with guaranteed asymptotic rejection of bounded unknown drift terms, explicitly accounting for heterogeneous agent dynamics, unmodeled behaviors, and environmental perturbations. Our theoretical findings are corroborated by numerical experiments spanning heterogeneous oscillators, traffic systems, and swarm robotics in partially unknown environments.

eess.SY↗

Bio-inspired density control of multi-agent swarms via leader-follower plasticity

The design of control systems for the spatial self-organization of mobile agents is an open challenge across several engineering domains, including swarm robotics and synthetic biology. Here, we propose a bio-inspired leader-follower solution, which is aware of energy constraints of mobile agents and is apt to deal with large swarms. Akin to many natural systems, control objectives are formulated for the entire collective, and leaders and followers are allowed to plastically switch their role in time. We frame a density control problem, modeling the agents' population via a system of nonlinear partial differential equations. This approach allows for a compact description that inherently avoids the curse of dimensionality and improves analytical tractability. We derive analytical guarantees for the existence of desired steady-state solutions and their local stability for one-dimensional and higher-dimensional problems. We numerically validate our control methodology, offering support to the effectiveness, robustness, and versatility of our proposed bio-inspired control strategy.

eess.SY↗

Adaptive Optimal Control for Avatar-Guided Motor Rehabilitation in Virtual Reality

A control-theoretic framework for autonomous avatar-guided rehabilitation in virtual reality, based on interpretable, adaptive motor guidance through optimal control, is presented. The framework faces critical challenges in motor rehabilitation due to accessibility, cost, and continuity of care, with over 50% of patients inability to attend regular clinic sessions. The system enables post-stroke patients to undergo personalized therapy in immersive virtual reality at home, while being monitored by clinicians. The core is a nonlinear, human-in-the-loop control strategy, where the avatar adapts in real time to the patient's performance. Balance between following the patient's movements and guiding them to ideal kinematic profiles based on the Hogan minimum-jerk model is achieved through multi-objective optimal control. A data-driven "ability index" uses smoothness metrics to dynamically adjust control gains according to the patient's progress. The system was validated through simulations and preliminary trials, and shows potential for delivering adaptive, engaging and scalable remote physiotherapy guided by interpretable control-theoretic principles.

eess.SY↗

Decentralized Shepherding of Non-Cohesive Swarms Through Cluttered Environments via Deep Reinforcement Learning

This paper investigates decentralized shepherding in cluttered environments, where a limited number of herders must guide a larger group of non-cohesive, diffusive targets toward a goal region in the presence of static obstacles. A hierarchical control architecture is proposed, integrating a high-level target assignment rule, where each herder is paired with a selected target, with a learning-based low-level driving module that enables effective steering of the assigned target. The low-level policy is trained in a one-herder-one-target scenario with a rectangular obstacle using Proximal Policy Optimization and then directly extended to multi-agent settings with multiple obstacles without requiring retraining. Numerical simulations demonstrate smooth, collision-free trajectories and consistent convergence to the goal region, highlighting the potential of reinforcement learning for scalable, model-free shepherding in complex environments.

eess.SY↗