SEARCH · arXiv Science

Search arXiv Science

Search indexed arXiv papers on artificial intelligence, large language models, computer vision and robotics. Read source abstracts and follow links to arXiv.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2Linked to original sources

arXiv2026

Performance Guarantees for Data-Driven Sequential Decision-Making

The solutions to many sequential decision-making problems are characterized by dynamic programming and Bellman's principle of optimality. However, due to the inherent complexity of solving Bellman's equation exactly, there has been significant interest in developing various approximate dynamic programming (ADP) schemes to obtain near-optimal solutions. A fundamental question that arises is: how close are the objective values produced by ADP schemes relative to the true optimal objective values? In this paper, we develop a general framework that provides performance guarantees for ADP schemes in the form of ratio bounds. Specifically, we show that the objective value under an ADP scheme is at least a computable fraction of the optimal value. We further demonstrate the applicability of our theoretical framework through several applications: data-driven robot path planning, pendulum stabilization, and multi-agent sensor coverage.

eess.SY↗

arXiv2026

Networked Multi-Resource Defense Capabilities in a General Lotto Game

Ensuring the security of complex systems involves the strategic allocation of defensive resources to prevent various types of attacks from succeeding. A defender often has multiple types of defensive assets at its disposal, where it must decide how to optimally deploy their heterogeneous capabilities across different attack types. In this paper, we formulate a multi-resource allocation problem in the form of a General Lotto game where a defender possesses various types of resources. A feature that we introduce is that their individual effectiveness against different types of attacks is characterized by a network weight matrix. In our analysis, we derive upper and lower bounds on the performance of the defender, and provide numerical evidence suggesting that they are tight. For the case of two attack types, we analytically prove that the bounds coincide, establishing an exact equilibrium characterization. We then numerically compare our proposed networked multi-resource architecture to an independent-defense benchmark from the existing literature. These results highlight fundamental and tractable structures underlying multi-attack-type defense problems.

cs.GT↗

arXiv2026

Traffic smoothing through automated vehicle control with optimal parameter selection

Stop-and-go traffic waves are known for reducing the efficiency of transportation systems by increasing traffic oscillations and energy consumption. In this study, we develop an approach to synthesize a class of additive feedback controllers for automated vehicles (AVs) to smooth nonlinear mixed traffic flow, including both AVs and human-driven vehicles (HVs). Unlike recent explicit AV controllers that rely on strict assumptions such as time-varying equilibrium traffic speed, our proposed AV controller requires only local traffic information, such as inter-vehicle spacing and relative speed, which are readily available through AV onboard sensors. Essentially, it allows a controlled AV to track a subtler version of the perturbed speed profile resulting from its preceding vehicle, thereby enabling smoother traffic flow. Additionally, we provide a method for selecting the optimal control parameters to achieve traffic-smoothing effects efficiently. These unique features of the developed AV controller ensure much higher implementability. We demonstrate the effectiveness of the proposed approach through simulations of two distinct traffic scenarios with varying levels of oscillation. The results show that AVs using the proposed controller are capable of effectively reducing traffic oscillations and lowering vehicle fuel consumption by up to 46.78\% and 2.74\%, respectively, for a platoon of 10 vehicles. The traffic-smoothing effect of the controller is more pronounced at higher penetration rates of AVs. While the performance of the proposed approach is slightly less superior to that of the most recent additive AV controller, it offers greater implementability and provides an efficient method for selecting optimal control parameters.

eess.SY↗

arXiv2026

Set-based state estimation of nonlinear discrete-time systems using constrained zonotopes and polyhedral relaxations

This paper presents a new algorithm for set-based state estimation of nonlinear discrete-time systems. A key step in such algorithms is to propagate a set (often a zonotope or constrained zonotope) through a nonlinear function. Existing methods accomplish this through conservative linearization procedures that are known to lead to severe overestimation in many cases. Here, we propose an alternative that avoids linearization using the so-called factorable representation of nonlinear functions. We use a recursive polyhedral relaxation technique based on this representation that is well-established in the global optimization literature but has not previously been used for set-based estimation. This technique is combined with constrained zonotope (CZ) technology to avoid the limitations of recursive computations with polyhedra in halfspace representation. The resulting state estimation method is fully automated, has attractive computational complexity (with one caveat discussed herein), and can provide significantly tighter enclosures than those resulting from linearization procedures in many cases. Numerical examples highlight the advantages of this approach relative to existing CZ methods based on the Mean Value Theorem and Difference of Convex functions (DC) programming.

eess.SY↗

arXiv2026

Reevaluating Bluetooth Low Energy for Ingestible Electronics

Bluetooth Low Energy (BLE) is widely used in wearable devices but has rarely been considered for ingestible electronics because of severe tissue attenuation at 2.4 GHz. In this work, we systematically reevaluate BLE for ingestible applications by benchmarking it against representative Sub-GHz schemes in terms of tissue attenuation, power consumption, throughput, reliability, bidirectional communication, latency, and system integration. Water-phantom and in vivo measurements confirm stronger attenuation at 2.4 GHz, by approximately 40 dB; however, front-end-module (FEM)-assisted BLE compensates for this loss while maintaining practical received signal levels and energy efficiency. For ingestible sensing applications requiring below 100 kbps, BLE with a 20 dBm transmission power achieves lower power consumption than the evaluated Sub-GHz alternatives. BLE also provides protocol-level reliability through retransmission and in-order packet delivery, whereas Sub-GHz links can suffer packet loss under high attenuation. In addition, BLE supports bidirectional communication with limited throughput degradation, while the evaluated Sub-GHz implementation shows a substantial reduction. End-to-end measurements further demonstrate lower BLE latency because of its native compatibility with modern computing infrastructure. Finally, BLE offers advantages in antenna form factor, ecosystem support, and system integration. These results demonstrate that properly configured BLE is a practical communication solution for next-generation ingestible electronics.

eess.SY↗

arXiv2026

Semi-discrete Optimal Transport for Time-Varying Multi-Agent Coverage Control

Coverage control algorithms have traditionally focused on static target densities, where agents optimally cover a fixed spatial distribution. However, many applications, such as environmental monitoring, surveillance, and adaptive sensing, involve time-varying densities. While time-varying coverage has been studied in Voronoi-based frameworks, extending recent optimal transport formulations of static coverage control to time-varying target densities remains an open problem. This paper presents a semi-discrete optimal transport framework for time-varying coverage control, in which agents track the first-order optimality conditions associated with minimizing the instantaneous Wasserstein distance from an evolving target density. The proposed approach is based on a coupled system of differential equations governing agent positions and the dual variables defining Laguerre regions. The resulting optimality residuals converge exponentially to zero, with global convergence established for one-dimensional domains. We also derive decentralized approximations and numerical simulations demonstrate improved tracking performance over quasi-static and Voronoi-based methods.

eess.SY↗

arXiv2026

Approximately Optimal Multi-Stream Quickest Change Detection

This paper considers the constrained sampling multi-stream quickest change detection problem, also known as the bandit quickest change detection problem. One stream contains a change-point that shifts its mean by an unknown amount. The goal is to quickly detect this change while controlling for false alarms, while being only able to sample one stream at each time. We propose an algorithm that combines a decaying-$ε$-greedy stream switching rule with a Generalized Likelihood Ratio detection procedure for unknown post-change means. We provide performance bounds for our algorithm and show it achieves approximate asymptotic first-order optimality with respect to a commonly used surrogate. We are the first to provide guarantees in this setting without assumptions such as a discretized post-change parameter set or a lower bound on the magnitude of change. We provide guarantees for a wide range of light-tailed distributions, including sub-Gaussian and bounded support distributions.

eess.SY↗

arXiv2026

Data Requirements for Electric Grid Topology and Admittance Estimation

Recent advances in precise phasor measurement units are enabling new approaches to estimate distribution and transmission grid parameters in real-time. In this paper, we investigate voltage and current phasor measurement requirements to estimate the electric grid topology and admittance parameters. We show necessary and sufficient conditions for the number of independent operating points (measurements) required to determine the topology and admittance of a completely unknown electric grid. With prior topology information, we also show that there is a minimum number of measurements required to uniquely determine the admittance matrix and corresponding grid topology. In the presence of noisy phasor measurements, we show that the admittance matrix can be estimated using a structured total least squares approach. By means of numerical simulations on the IEEE 13-node distribution feeder, the IEEE 14-node transmission network, and the IEEE 123-node distribution feeder, we demonstrate our approach is suitable for applications in radial and mesh grid topologies in the presence of measurement noise.

eess.SY↗

arXiv2026

From World Models to World Action Models: A Concise Tutorial for Robotics

Rather than providing an exhaustive survey, this paper presents a concise tutorial on world models and world action models for robotics. After reading the tutorial, readers should have a clear understanding of what constitutes a "world", how world models and world action models are defined, and what roles they play within robotic AI systems. The tutorial also develops a unified perspective for comparing representative approaches, such as World Labs' spatial intelligence models, Yann LeCun's JEPA framework, and NVIDIA's Cosmos platform, and clarifies how these models differ in their representations, predictive capabilities, and interaction mechanisms.

cs.RO↗

arXiv2026

An AI-Based Decision-Support Pipeline for Day-Ahead Photovoltaic Forecasting

Reliable photovoltaic (PV) forecasts can support low-carbon energy systems, but deployed sites may have only short and incomplete records. Physical and hybrid methods can be sensitive to weather inputs, calibration, and timestamp-alignment, while individual machine learning models may capture different parts of the forecasting problem. We study hourly day-ahead PV forecasting at a United Kingdom charging station using one year of inverter measurements, with 9.25% of hours missing. The pipeline checks timestamp-alignment, derives solar and clearness features, adds short-term weather context, and combines five complementary models using non-negative least squares stacking, with the combination fitted only on validation observations. We compare against smart persistence, a weather-scaled baseline that carries the previous day's PV behaviour forward using target-day irradiance. With retrospective weather, the combined model reduces daylight normalised root mean square error (RMSE) by 31.2% under random day-fold evaluation and by 2.9% under rolling-origin evaluation, although the latter improvement is not robust across days. It also improves by 3.0% over the single model selected from validation performance. Replacing retrospective weather with a public product sampled at a constant 24-hour lead increases daylight RMSE by 13.1% and 4.2% under the two protocols, while retaining positive skill over smart persistence.

cs.LG↗

arXiv2026

Adaptive Nonlinear Control with Online Identification and Receding-Horizon Optimization

An adaptive nonlinear optimal-control scheme is developed by combining receding-horizon iLQR, state estimation, online parameter identification, and actuator constraints. AMIGO (Adaptive Model-based Intelligent Guidance and Orchestration) organizes the computation into three Time Phases: identification, planning, and closed-loop control. A supervisory adaptive loop monitors predictive consistency during closed-loop operation and can repeat identification and planning when persistent parameter mismatch is detected. The nonlinear transition is evaluated by the fourth-order Runge-Kutta method (RK4), and model parameters are refined by the Levenberg-Marquardt method (LM). The method is illustrated by a Van der Pol oscillator, a quadcopter, and an autonomous lunar-lander descent.

eess.SY↗

arXiv2026

On the Local and Global Nature of Frequency and Voltage Dynamics

This paper utilizes the autocorrelation of frequency and voltage measurements to identify, quantify and classify local and global properties of power system dynamics. The analysis is based on measurements with various resolutions (20 ms, 1 s, and 1 min) from several nodes of the Irish All-Island Power System (AIPS). Simulations based on stochastic differential algebraic equations on an IEEE benchmark system support conclusions drawn from real-world data.

eess.SY↗

arXiv2026

A Two-Stage, Model-Based Reinforcement Learning Approach for Active Flow Control of Bluff Body Wakes

This paper develops a data-driven, output-feedback approach to the infinite-horizon optimal control of high-dimensional nonlinear systems with unknown and unstable equilibria, using sparse partial observations. The approach builds on the transfer-plus-regulation decomposition of the infinite-horizon problem: a finite-horizon nonlinear transfer drives the system into a region where the dynamics are well-approximated by a linear model about the unknown operating point, and an infinite-horizon linear regulator identified within that region completes stabilization. We extend this framework to the partially observed setting by combining an ARMA-based information-state construction with a two-stage control architecture: an iterative linear quadratic regulator (iLQR) approach on the information state drives the system to the equilibrium neighborhood, discovered implicitly without prior knowledge of the target, and a locally identified time-invariant ARMA model provides the infinite-horizon regulator for asymptotic stabilization. The method requires no adjoint solver, reduced-order model, or full-state access. We validate the approach on high-fidelity Navier-Stokes simulations of the cylinder wake at $\mathrm{Re}=100$ using only eight surface pressure sensors, an order of magnitude fewer than recent model-based RL methods. The controller achieves complete suppression of vortex-shedding-induced lift oscillations and a $44\%$ reduction in total drag relative to the uncontrolled baseline.

eess.SY↗

arXiv2026

Entropic Risk-Sensitive Evolutionary Learning and Equilibrium Selection in Coordination Games

We study risk-sensitive evolutionary learning dynamics and their long-run equilibrium selection behaviors in coordination games. Agents' risk attitudes enter through the classical entropic risk measure, which evaluates opponent-induced payoff uncertainty and feeds into noisy best responses under two standard revision protocols: best response with mutations and logit choice. We first analyze $2\times 2$ coordination games in both single-population symmetric and two-population asymmetric settings. In the single-population setting, unlike the risk-neutral case where the dynamics are known to favor the risk-dominant equilibrium, we show that risk sensitivity can change the stochastically stable outcome: a greater risk-seeking attitude favors the payoff-dominant equilibrium, while a greater risk-averse attitude favors the maximin equilibrium. Thus, the population's risk attitude may act as a control knob for long-run equilibrium selection. In both population settings, we also identify a robust regime: any super-dominant equilibrium is stochastically stable for all risk attitudes, under both protocols, and across populations. We further extend the single-population analysis to symmetric $k$-action games, which include symmetric $k$-action coordination games as a special case, under risk-sensitive best response with mutations. In this setting, we show that, for sufficiently large populations, sufficiently risk-seeking agents uniquely select the strongly payoff-dominant equilibrium when it exists, whereas sufficiently risk-averse agents uniquely select the strongly maximin equilibrium when it exists. These results show that entropic risk sensitivity may serve as a systematic mechanism for steering equilibrium selection in evolutionary games, beyond the classical risk-neutral benchmark.

eess.SY↗

arXiv2026

Model Predictive Control for Dynamic Hydraulic Balancing in Building Radiator Heating Systems: Modeling, Design, and Experimental Validation

Hydronic radiator systems are among the most widely used heating systems in buildings. In the literature, radiator heat outputs are often assumed to be independent of one another and arbitrarily adjustable in time when designing controllers. However, in practice, radiators are supplied by one or multiple common heat sources and are hydraulically coupled through the water circulation system. Maintaining occupant comfort in multi-zone buildings therefore requires not only an appropriate supply temperature but also proper hydraulic balancing to distribute the available water flow according to the heating demand of each zone. To this end, we develop a grey-box thermal model that captures the hydraulic interactions among radiators and the effects of radiator valves, circulation pumps, and heat sources. In a real building, we show that accounting for hydraulic interactions reduces the root mean square error (RMSE) between the measured and modeled zone temperatures by approximately 11% compared with a model that neglects these interactions. Additionally, we integrate the developed model into a model predictive control (MPC) framework for dynamic hydraulic balancing that jointly optimizes valve openings and the supply temperature to maintain thermal comfort in each zone while reducing energy consumption. Through both real-world experiments and numerical case studies, we demonstrate that, compared with existing MPC formulations that neglect hydraulic interactions or do not control radiator valves, the proposed MPC reduces comfort-range violations by at least 27% while requiring a similar or even lower cumulative supply temperature.

eess.SY↗

arXiv2026

NL-FRA: A MATLAB package for nonlinear frequency response analysis

Nonlinear Output Frequency Response Functions (NOFRFs) provide a one-dimensional frequency-domain representation of nonlinear dynamics, enabling direct decomposition of an output spectrum into contributions from different orders of nonlinearity. NL-FRA (NonLinear Frequency Response Analysis) is an open-source MATLAB package implementing a data-driven Least Squares (LS) method for estimating NOFRFs directly from system input-output data. It provides an integrated workflow for NOFRF estimation, validation, and visualisation, together with nonlinear transmissibility analysis. The package supports different types of inputs, i.e. general band-limited, multi-one and harmonic inputs, and includes routines for identifying the frequency ranges over which each nonlinear order contributes to the output. Furthermore, since the LS approach estimates NOFRFs directly from input-output data, it can be applied to experimental measurements or data generated using any suitable dynamic model of the system. The software facilitates interpretable nonlinear frequency-domain analysis for applications including fault diagnosis, condition and structural health monitoring, and biomedical engineering.

eess.SY↗

arXiv2026

Optimal input design via Frank-Wolfe

We study optimal input design over a finite horizon for linear dynamical systems. The goal is to minimize a weighted inverse-covariance (information) criterion subject to an energy budget. The set of covariances achievable by causal policies is convex but lacks a tractable explicit description, ruling out projection-based methods. We show that Frank--Wolfe applies naturally: each linear minimization subproblem is a budget-constrained finite-horizon linear quadratic (LQ) problem, solvable by a Riccati recursion and one-dimensional bisection over a Lagrange multiplier. Using smoothness of the objective over the feasible set, we establish an $\mathcal{O}(1/M)$ convergence rate for the objective value, while strong convexity yields an $\mathcal{O}(1/\sqrt{M})$ rate for the iterates. We further extend the framework to input design for system identification with unknown dynamics and adaptive online LQR, and illustrate the approach numerically.

math.OC↗

arXiv2026

Asynchronous Model Predictive Control Under Model Mismatch: Stability and Performance Guarantees

Certainty-equivalence model predictive control (CE-MPC) is widely used for its simplicity and efficiency, but theoretical guarantees under asynchronous feedback remain limited. This paper establishes stability and performance guarantees for asynchronous CE-MPC of input-constrained nonlinear systems. We first derive a nominal stability condition and competitive-ratio bound that explicitly account for inter-execution intervals without prescribing a feedback mechanism. A value-function perturbation analysis for quadratic stage costs then accommodates additive, potentially non-smooth model mismatch without constraint qualification conditions. Combining these results yields stability criteria and competitive-ratio bounds for CE-MPC under general asynchronous feedback, including event/self-triggered and multi-step MPC. The guarantees explicitly relate prediction horizon, inter-execution time, and uncertainty magnitude, quantifying performance degradation relative to an ideal infinite-horizon controller. These results clarify tradeoffs between feedback frequency, model accuracy, and horizon length, guiding asynchronous MPC design using approximate or learned models.

eess.SY↗