arXiv subjects

Maxim Staritsyn

Publications and source records attributed to Maxim Staritsyn.

12 recordsLinked to original sources

arXiv2026

Exact Cost-Increment Formula for Optimal Control of Semilinear Evolution Equations

We address optimal control of semilinear evolution equations on Banach spaces with finitely many control channels, a framework encompassing a broad class of infinite-dimensional dynamical systems, arising in many applications. For this setting, we derive an exact and global formula quantifying the increment of the cost functional with respect to an arbitrary reference control. This identity enables the design of monotone descent algorithms that require no linearization or step-size tuning. We further establish the existence of optimal controls and propose a practical sample-and-hold realization of the descent step suitable for numerical implementation. The effectiveness of the method is demonstrated on a controlled reaction-diffusion equation.

math.OC↗

arXiv2025

Indirect methods in optimal control on Banach spaces

This work focuses on indirect descent methods for optimal control problems governed by nonlinear ordinary differential equations in Banach spaces, viewed as abstract models of distributed dynamics. As a reference line, we revisit the classical schemes, rooted in Pontryagin's maximum principle, and highlight their sensitivity to local convexity and lack of monotone convergence. We then develop an alternative method based on exact cost-increment formulas and finite-difference probes of the terminal cost. We show that our method exhibits stable monotone convergence in numerical analysis of an Amari-type neural field control problem.

math.OC↗

arXiv2025

From Few-Shot Optimal Control to Few-Shot Learning

We present an approach to solving unconstrained nonlinear optimal control problems for a broad class of dynamical systems. This approach involves lifting the nonlinear problem to a linear ``super-problem'' on a dual Banach space, followed by a non-standard ``exact'' variational analysis, -- culminating in a descent method that achieves rapid convergence with minimal iterations. We investigate the applicability of this framework to mean-field control and discuss its perspectives for the analysis of information propagation in self-interacting neural networks.

math.OC↗

arXiv2025

Super-duality and necessary optimality conditions of order "infinity" in optimal control theory

We systematically introduce an approach to the analysis and (numerical) solution of a broad class of nonlinear unconstrained optimal control problems, involving ordinary and distributed systems. Our approach relies on exact representations of the increments of the objective functional, drawing inspiration from the classical Weierstrass formula in Calculus of Variations. While such representations are straightforward to devise for state-linear problems (in vector spaces), they can also be extended to nonlinear models (in metric spaces) by immersing them into suitable linear "super-structures". We demonstrate that these increment formulas lead to necessary optimality conditions of an arbitrary order. Moreover, they enable to formulate optimality conditions of "infinite order", incorporating a kind of feedback mechanism. As a central result, we rigorously apply this general technique to the optimal control of nonlocal continuity equations in the space of probability measures.

math.OC↗

arXiv2025

Optimal Control of Nonlocal Balance Equations

The paper presents an approach to studying optimal control problems in the space of nonnegative measures with dynamics given by a nonlocal balance law. This approach relies on transforming the balance law into a continuity equation in the space of probabilities, and subsequently into an ODE in a Hilbert space. The main result is a version of Pontryagin's maximum principle for the addressed problem, which encompasses all known formulations of this type in mean field control theory.

math.OC↗

arXiv2024

On Minimum-Dispersion Control of Nonlinear Diffusion Processes

This work collects some methodological insights for numerical solution of a "minimum-dispersion" control problem for nonlinear stochastic differential equations, a particular relaxation of the covariance steering task. The main ingredient of our approach is the theoretical foundation called $\infty$-order variational analysis. This framework consists in establishing an exact representation of the increment ($\infty$-order variation) of the objective functional using the duality, implied by the transformation of the nonlinear stochastic control problem to a linear deterministic control of the Fokker-Planck equation. The resulting formula for the cost increment analytically represents a "law-feedback" control for the diffusion process. This control mechanism enables us to learn time-dependent coefficients for a predefined Markovian control structure using Monte Carlo simulations with a modest population of samples. Numerical experiments prove the vitality of our approach.

math.OC↗

arXiv2024

Optimal control of diffusion processes: $\infty$-order variational analysis and numerical solution

We tackle a nonlinear optimal control problem for a stochastic differential equation in Euclidean space and its state-linear counterpart for the Fokker-Planck-Kolmogorov equation in the space of probabilities. Our approach is founded on a novel concept of local optimality surpassing Pontryagin's minimum, originally crafted for deterministic optimal ensemble control problems. A key practical outcome is a rapidly converging numerical algorithm, which proves its feasibility for problems involving Markovian and open-loop strategies.

math.OC↗

arXiv2023

Optimal control of nonlocal continuity equations: numerical solution

The paper addresses an optimal ensemble control problem for nonlocal continuity equations on the space of probability measures. We admit the general nonlinear cost functional, and an option to directly control the nonlocal terms of the driving vector field. For this problem, we design a descent method based on Pontryagin's maximum principle (PMP). To this end, we derive a new form of PMP with a decoupled Hamiltonian system. Specifically, we extract the adjoint system of linear nonlocal balance laws on the space of signed measures and prove its well-posedness. As an implementation of the designed descent method, we propose an indirect deterministic numeric algorithm with backtracking. We prove the convergence of the algorithm and illustrate its modus operandi by treating a simple case involving a Kuramoto-type model of a population of interacting oscillators.

math.OC↗

arXiv2023

Optimal control of distributed ensembles with application to Bloch equations

Motivated by the problem of designing robust composite pulses for Bloch equations in the presence of natural perturbations, we study an abstract optimal ensemble control problem in a probabilistic setting with a general nonlinear performance criterion. The model under study addresses mean-field dynamics described by a linear continuity equation in the space of probability measures. For the resulting optimization problem, we derive an exact representation of the increment of the cost functional in terms of the flow of the driving vector field. Relying on the exact increment formula, a descent method is designed that is free of any internal line search. The numerical method is applied to solve new control problems for distributed ensembles of Bloch equations.

math.OC↗

arXiv2023

Optimization of external stimuli for populations of theta neurons via mean-field feedback control

We study a problem of designing ``robust'' external excitations for control and synchronization of an assembly of homotypic harmonic oscillators representing so-called theta neurons. The model of theta neurons (Theta model) captures, in main, the bursting behavior of spiking cells in the brain of biological beings, enduring periodic oscillations of the electric potential in their membrane. We study the following optimization problem: to design an external stimulus (control), which steers all neurons of a given population to their desired phases (i.e., excites/slows down its spiking activity) with the highest probability. This task is formulated as an optimal mean-field control problem for the local continuity equation in the space of probability measures. To solve this problem numerically, we propose an indirect deterministic descent method based on an exact representation of the increment (infinite-order variation) of the objective functional. We discuss some aspects of practical realization of the proposed method, and provide results of numerical experiments.

math.OC↗

arXiv2021

Feedback maximum principle for ensemble control of local continuity equations. An application to supervised machine learning

We consider an optimal control problem for a system of local continuity equations on a space of probability measures. Such systems can be viewed as macroscopic models of ensembles of non-interacting particles or homotypic individuals, representing several different ``populations''. For the stated problem, we propose a necessary optimality condition, which involves feedback controls inherent to the extremal structure, designed via the standard Pontryagin's Maximum Principle conditions. This optimality condition admits a realization as an iterative algorithm for optimal control. As a motivating case, we discuss an application of the derived optimality condition and the consequent numeric method to a problem of supervised machine learning via dynamic systems.

math.OC↗

arXiv2020

Impulsive control of nonlocal transport equations

The paper extends an impulsive control-theoretical framework towards dynamic systems in the space of measures. We consider a transport equation describing the time-evolution of a conservative "mass" (probability measure), which represents an infinite ensemble of interacting particles. The driving vector field contains nonlocal terms and it is affine in the control variable. The control is assumed to be common for all the agents, i.e., it is a function of time variable only. The main feature of the addressed model is the admittance of "shock" impacts, i.e. controls, whose influence on each agent can be arbitrary close to Dirac-type distributions. We construct an impulsive relaxation of this system and of the corresponding optimal control problem. For the latter we establish a necessary optimality condition in the form of Pontryagin's Maximum Principle.

math.OC↗