arXiv Science⌕ Search

arXiv subjects

Hongjiang Qian

Publications and source records attributed to Hongjiang Qian.

8 recordsLinked to original sources

Moderate deviations for semilinear stochastic evolution equations in fast Markovian environments

This work establishes moderate deviation principles for semilinear stochastic evolution equations with coefficients depending on fast Markov environments. The environment is either an exponentially ergodic Markov process on a Polish space, independent of the noise, or a finite-state Markov chain whose transition rates depend on time and on a finite-dimensional observation of the state. The rate function is quadratic in the residual of the linearized dynamics. Its covariance is the sum of the averaged covariance of the Wiener noise and the asymptotic covariance generated by the environment, given by a Green--Kubo formula in the independent case and by a Poisson equation in the switching case. The rate function is written with the Moore--Penrose inverse of the square root of this covariance and requires the residual to lie in its range, not merely in the closure. This allows degenerate covariances and nonclosed ranges. In the switching case, the dependence of the invariant distribution on the slow state adds an extra term to the linearized drift. Since the stochastic convolution is not a semimartingale, the proofs combine the regeneration split chain technique with Galerkin approximation. The assumptions are verified for stochastic reaction--diffusion equations, including space-time white noise in one spatial dimension.

math.PR↗

Time inconsistent linear quadratic optimal control for mean field games in Hilbert spaces

This paper studies time-inconsistent linear-quadratic mean-field games governed by stochastic evolution equations in Hilbert spaces. The time inconsistency arises through the dependence of the cost functional on the initial time, while the mean-field interaction enters through the mean of the state distribution. By employing a multiperson differential game approach, we show that the closed-loop equilibrium strategy admits an affine feedback representation characterized by an operator-valued Riccati equation and a novel coupled forward-backward equilibrium system. We establish the existence and uniqueness of mild solutions to the equilibrium system and hence the existence of a closed-loop equilibrium strategy.

math.OC↗

Smoluchowski-Kramers Approximation Meets Khasminskii Averaging Principles in Nonequilibrium Random Environments I

This work establishes a simultaneous Smoluchowski-Kramers approximation and Khasminskii averaging principle for a class of second-order stochastic differential equations (SDEs) in nonequilibrium random environments. The system describes the motion of a particle of mass $m>0$ subject to external forces, friction, and noise, all of which depend on a fluctuating environment such as a stochastic heat bath. The environment is modeled by a fast-varying first-order SDE, where a parameter $0<ε\ll 1$ encodes the time-scale separation. Under the scaling $m=ε^2$, the slow process converges in probability to an effective dynamics with averaged drift and noise-induced coefficients. Our analysis utilizes a pathwise integration-by-parts formula and Poisson equations associated with the fast dynamics. Finally, numerical experiments are provided for demonstration.

math.PR↗

Maximum Principles for Partially Observed Controls of Forward SPDEs and Backward SDEs with Jumps

This work establishes two versions of the Pontryagin-type maximum principles for partially observed optimal control of coupled forward stochastic partial differential equations (FSPDEs) and backward stochastic differential equations (BSDEs) with jumps in convex control domains. The FSPDE-BSDE system is driven by cylindrical Wiener processes, finite-dimensional Brownian motions, and compensated Poisson random measures. For systems with deterministic coefficients, a direct method is employed and particular attention is focused on establishing the well-posedness of a singular backward SPDE with jumps. For systems with random coefficients, a Malliavin calculus approach is developed. The main novelty here is the establishment of the well-posedness of an operator-valued SPDE with jumps, which provides a new stochastic flow representation for linear SPDEs with jumps.

math.OC↗

Moderate Deviation Principles for Stochastic Differential Equations in Fast-Varying Markovian Environment

In this paper, we proved moderate deviation principles for a fully coupled two-time-scale stochastic systems, where the slow process is given by stochastic differential equations with small noise, while the fast process is a rapidly changing purely jump process on finite state space. The system is fully coupled in that the drift and diffusion coefficients of the slow process, as well as the jump distribution of the fast process, depend on states of both processes. Moreover, the diffusion component in the slow process can be degenerate. Our approach is based on the combination of the weak convergence method from [A. Budhiraja, P. Dupuis, and A. Ganguly, Electron. J. Probab. 23 (2018), pp. 1-33; Ann. Probab. 44 (2016), pp. 1723-1775] with Poisson equation for the fast-varying purely jump process.

math.PR↗

Optimal Control of Stochastic Partial Differential Equations with Partial Observations: Stochastic Maximum Principles and Numerical Approximation

This work establishes a general stochastic maximum principle for partially observed optimal control of semi-linear stochastic partial differential equations in a nonconvex control domain. The state evolves in a Hilbert space driven by a cylindrical Wiener process and finitely many Brownian motions, while observations are in an Euclidean space having correlated noise. For convex control domain and diffusion coefficients in the state being control-independent, numerical algorithms are developed to solve the partially observed optimal control problems using stochastic gradient descent algorithm combined with finite element approximations and the branching filtering algorithm. Numerical experiments are conducted for demonstration.

math.OC↗

Numerical approximations for partially observed optimal control of stochastic partial differential equations

In this paper, we study numerical approximations for optimal control of a class of stochastic partial differential equations with partial observations. The system state evolves in a Hilbert space, whereas observations are given in finite-dimensional space $\rr^d$. We begin by establishing stochastic maximum principles (SMPs) for such problems, where the system state is driven by a cylindrical Wiener process. The corresponding adjoint equations are characterized by backward stochastic partial differential equations. We then develop numerical algorithms to solve the partially observed optimal control. Our approach combines the stochastic gradient descent method, guided by the SMP, with a particle filtering algorithm to estimate the conditional distributions of the state of the system. Finally, we demonstrate the effectiveness of our proposed algorithm through numerical experiments.

math.OC↗

Large Deviations Analysis For Regret Minimizing Stochastic Approximation Algorithms

Motivated by learning of correlated equilibria in non-cooperative games, we perform a large deviations analysis of a regret minimizing stochastic approximation algorithm. The regret minimization algorithm we consider comprises multiple agents that communicate over a graph to coordinate their decisions. We derive an exponential decay rate towards the algorithm's stable point using large deviations theory. Our analysis leverages the variational representation of the Laplace functionals and weak convergence methods to characterize the exponential decay rate.

math.OC↗