arXiv ScienceSearch

arXiv subjects

Yingjun Mo

Publications and source records attributed to Yingjun Mo.

4 recordsLinked to original sources

Tamed Euler-Maruyama method for SDEs with non-globally Lipschitz drift and multiplicative noise

Consider the following stochastic differential equation driven by multiplicative noise on $\mathbb{R}^d$ with a superlinearly growing drift coefficient, \begin{align*} \mathrm{d} X_t = b (X_t) \, \mathrm{d} t + \sigma (X_t) \, \mathrm{d} B_t. \end{align*} It is known that the corresponding explicit Euler schemes may not converge. In this article, we analyze an explicit and easily implementable numerical method for approximating such a stochastic differential equation, i.e. its tamed Euler-Maruyama approximation. Under partial dissipation conditions ensuring the ergodicity, we obtain the uniform-in-time convergence rates of the tamed Euler-Maruyama process under $L^{1}$-Wasserstein distance and total variation distance.

math.PR

Approximation to Deep Q-Network by Stochastic Delay Differential Equations

Despite the significant breakthroughs that the Deep Q-Network (DQN) has brought to reinforcement learning, its theoretical analysis remains limited. In this paper, we construct a stochastic differential delay equation (SDDE) based on the DQN algorithm and estimate the Wasserstein-1 distance between them. We provide an upper bound for the distance and prove that the distance between the two converges to zero as the step size approaches zero. This result allows us to understand DQN's two key techniques, the experience replay and the target network, from the perspective of continuous systems. Specifically, the delay term in the equation, corresponding to the target network, contributes to the stability of the system. Our approach leverages a refined Lindeberg principle and an operator comparison to establish these results.

cs.LG

Existence and non-existence of the CLT for a family of SDEs driven by stable process

Stochastic differential equations (SDEs) without global Lipschitz drift often demonstrate unusual phenomena. In this paper, we consider the following SDE on $\mathbb R^d$: \begin{align*} \mathrm{d} \mathbf{X}_t=\mathbf{b}(\mathbf{X}_t) \mathrm{d} t+ \mathrm{d}\mathbf{Z}_t, \quad \mathbf{X}_0=\mathbf{x} \in \mathbb{R}^d, \end{align*} where $\mathbf{Z}_t$ is the rotationally symmetric $\alpha$-stable process with $\alpha \in(1,2)$ and $\mathbf{b}:\mathbb{R}^d \rightarrow \mathbb{R}^d$ is a differentiable function satisfying the following condition: there exist some $\theta \ge 0$, and $K_1 , K_2 , L>0$, so that $$\langle \mathbf{b}(\mathbf{x})-\mathbf{b}(\mathbf{y}), \mathbf{x}-\mathbf{y}\rangle \leqslant K_1 |\mathbf{x}-\mathbf{y}|^2, \ \ \forall \ \ |\mathbf{x}-\mathbf{y}| \leqslant L, $$ $$\langle \mathbf{b}(\mathbf{x})-\mathbf{b}(\mathbf{y}), \mathbf{x}-\mathbf{y}\rangle \leqslant -K_2 |\mathbf{x}-\mathbf{y}|^{2+\theta}, \ \ \forall \ \ |\mathbf{x}-\mathbf{y}| > L.$$ Under this assumption, the SDE admits a unique invariant measure $\mu$. We investigate the normal central limit theorem (CLT) of the empirical measures $$ \mathcal{E}_t^\mathbf{x}(\cdot)=\frac{1}{t} \int_0^t \delta_{\mathbf{X}_s }(\cdot) \mathrm{d} s, \ \ \ \ \mathbf{X}_0=\mathbf{x} \in \mathbb{R}^d, \ \ t>0, $$ where $\delta_{\mathbf{x}}(\cdot)$ is the Dirac delta measure. Our results reveal that, for the bounded measurable function $h$, $$\sqrt t \left(\mathcal{E}_t^\mathbf{x}(h)-\mu(h)\right)=\frac{1}{\sqrt t} \int_0^t \left(h\left(\mathbf{X}_s^\mathbf{x}\right)-\mu(h)\right) \mathrm{d} s$$ admits a normal CLT for $\theta \geqslant 0$. For the Lipschitz continuous function $h$, the normal CLT does not necessarily hold when $\theta=0$, but it is satisfied for $\theta>1-\frac{\alpha}{2}$.

math.PR

Distribution estimation and change-point estimation for time series via DNN-based GANs

The generative adversarial networks (GANs) have recently been applied to estimating the distribution of independent and identically distributed data, and have attracted a lot of research attention. In this paper, we use the blocking technique to demonstrate the effectiveness of GANs for estimating the distribution of stationary time series. Theoretically, we derive a non-asymptotic error bound for the Deep Neural Network (DNN)-based GANs estimator for the stationary distribution of the time series. Based on our theoretical analysis, we propose an algorithm for estimating the change point in time series distribution. The two main results are verified by two Monte Carlo experiments respectively, one is to estimate the joint stationary distribution of $5$-tuple samples of a 20 dimensional AR(3) model, the other is about estimating the change point at the combination of two different stationary time series. A real world empirical application to the human activity recognition dataset highlights the potential of the proposed methods.

cs.LG