arXiv ScienceSearch

arXiv subjects

Sharan Srinivasan

Publications and source records attributed to Sharan Srinivasan.

4 recordsLinked to original sources

The BAR-SOT Method: Long-term Average Cost Control as Stochastic Optimal Self-Transport

We reformulate average-cost (ergodic) control of a Markov jump process as a finite-horizon stochastic optimal transport (SOT) problem that jointly optimizes over the controlled evolution and the marginal law from which it starts and returns to (i.e., a self-transport). The constraint relating the marginal flow to the controlled generator is the basic adjoint relationship (BAR), so we call the resulting problem BAR-SOT. For any time horizon T>0, its optimal value is a constant scaling of the long-run average-cost rate. We give three equivalent formulations (through controlled processes, a Fokker--Planck constraint, and relaxed marginal measures) and show that the optimal dual is a stationary potential plus a term linear in time, with slope equal to the rate. A relative-entropy penalty on the control yields a cost-tilted Schrodinger bridge problem, computable by a Sinkhorn-type iteration when every transition rate is controlled, whose value converges to the unregularized optimum as the penalty vanishes. We develop the theory for finite Markov decision processes and then for general controlled Markov jump processes. A neural parametrization of the dual, trained as a physics-informed neural network (PINN), that encodes Harrison's equivalent-workload formulation (see Harrison 2000) matches the strong reinforcement-learning baseline of Dai and Gluzman (2022); numerically conditioning the fit of a sub-dominant transverse correction then improves on both that baseline and the best priority heuristic. On the input-queued switch, a graph-attention parametrization of the dual improves on the strongest matching heuristic we are aware of, with a parameter count that does not grow with the switch size.

math.OC

Robust Filtering of Lévy-driven Stochastic Models

We study robust nonlinear filtering for stochastic models driven by Lévy processes, where the signal and observation processes are coupled through common Brownian and jump noise. Robustness, defined as the continuous dependence of the filter on the observation path, is essential whenever the observation process deviates from the idealized model, for instance when a path must be reconstructed from discrete-time samples. This question is well understood for continuous semimartingale systems but largely open in the presence of jumps. We construct a version of the filter and establish its continuity in two regimes. For processes with finitely many jumps on compact intervals, we prove continuity in both the rough $p$-variation and $p$-variation topologies on cadlag path space, without requiring a separability condition on the jump coefficients. For processes with infinitely many jumps, we prove continuity in a modified rough $p$-variation topology adapted to cadlag geometric rough paths, under an additional separability assumption. In both cases, our approach relies on Stratonovich and Marcus flow decompositions rather than the Itô-based methods of recent work. The resulting geometric rough-path lifts yield pathwise convergence guarantees and can be constructed directly from discrete observations without knowledge of the underlying probability law.

math.PR

The Variational Approach in Filtering and Correlated Noise

The variational formulation of nonlinear filtering due to Mitter and Newton characterizes the filtering distribution as the unique minimizer of a free energy functional involving the relative entropy with respect to the prior and an expected energy. This formulation rests on an absolute continuity condition between the joint path measure and a product reference measure. We prove that this condition necessarily fails whenever the signal and observation diffusions share a common noise source. Specifically we show that the joint and product measures are mutually singular, so no choice of reference measure can salvage the formulation. We then introduce a conditional variational principle that replaces the prior with a reference measure that preserves the noise correlation structure. This generalization recovers the Mitter--Newton formulation as a special case when the noises are independent, and yields an explicit free energy characterization of the filter in the linear correlated-noise setting.

math.PR

Linear Quadratic Control with Non-Markovian and Non-Semimartingale Noise Models

The standard linear quadratic Gaussian (LQG) framework assumes a Brownian noise process and relies on classical stochastic calculus tools, such as those based on Itô calculus. In this paper, we solve a generalized linear quadratic optimal control problem where the process and measurement noises can be non-Markovian and non-semimartingale stochastic processes with sample paths that have low Hölder regularity. Since these noise models do not, in general, permit the use of the standard Itô calculus, we employ rough path theory to formulate and solve the problem. By leveraging signature representations and controlled rough paths, we derive the optimal state estimation and control strategies.

eess.SY