arXiv Science⌕ Search

arXiv subjects

Qi-Man Shao

Publications and source records attributed to Qi-Man Shao.

At least 19 recordsLinked to original sources

Critical fluctuations in the edge--triangle exponential random graph models

We prove quantitative limit theorems for the edge density $Q$ in the dense edge--triangle exponential random graph model at criticality and under parameter perturbations of order $n^{-1}$. At the fixed critical parameters $(α_c,h_c),$ the centered fluctuations satisfy $n^{2/3}(Q-\mathbb{E} Q)\Rightarrow \mathcal{N}(0,σ_0^2)$, with explicit variance $σ_0^2>0$. This disproves the quartic fluctuation conjecture of Bianchi, Collet and Magnanini (2024). Gaussian limits also hold $(α_c+ λ/n,h_c + γ/n)$, except when the coefficients satisfy $-\frac{11}{16}+\frac{2}{9}(γ+\frac49λ)=0$. Under this linearity condition, the limiting laws of $\sqrt n(Q-2/3)$ have densities proportional to $\exp\{-81z^4/64+9θz^2/8\}$, where $θ=-57/16+8λ/27$. We obtain a sharp $n^{-1/3}$ rate in $1$-Wasserstein distance for the Gaussian limits and an $O(n^{-1/2})$ bound for the quartic limits. The proofs combine Stein's method for exchangeable pairs with conditional row estimates and a local Dobrushin contraction.

math.PR↗

Three quantitative central limit theorems for the unbounded excursion component of a Gaussian field

For a class of smooth stationary Gaussian fields, we study the fluctuations of the volume, surface area and Euler characteristic of the unbounded excursion component in growing boxes $Λ_n=[-n,n]^d$. We establish nondegenerate central limit theorems for all three functionals throughout the supercritical regime in every dimension $d\geq 2$. We further quantify these central limit theorems by establishing Berry--Esseen bounds of order $O\bigl(|Λ_n|^{-(1-1/s)}\bigr)$ in Kolmogorov distance, where $s\in(1,2]$ depend on the regularity and decay assumptions. Especially for the Bargmann--Fock field, we obtain a Berry--Esseen bound of $O\bigl(|Λ_n|^{-1/2}\bigr)$ for all three functionals. A matching lower bound shows that this rate is sharp for the Euler characteristic. For the volume, we improve the previously known rate of $O\bigl(|Λ_n|^{-1/2}(\log|Λ_n|)^{2d}\bigr)$. We mainly use Stein's method and moment bounds for differences arising from white-noise resampling to finish our proof.

math.PR↗

Berry-Esseen bounds for products of random matrices under a $2+δ$ polynomial moment

Let $(g_{k})_{k \geq 1}$ be a sequence of independent and identically distributed matrices with law $μ$ on $\mathrm{GL}(d,\mathbb{R})$, where $d\geq2$ is an integer. Suppose that the closed semigroup generated by the support of $μ$ is strongly irreducible and proximal and that the polynomial moment of order $2+δ$ is finite, where $0<δ\leq 1$. We establish a Berry-Esseen bound of order $n^{-δ/2}$ for $\log \| g_{n} \cdots g_{1} v\|$, where $v$ is a nonzero vector in $\mathbb{R}^{d}$ and $\|\cdot\|$ is an arbitrary norm on $\mathbb{R}^{d}$. As an application, we also obtain a Berry-Esseen bound of order $n^{-δ/2}$ for $\log \| g_{n} \cdots g_{1}\|$, where $\|\cdot\|$ is any matrix norm. The proof combines an $m$-dependent approximation with Stein's method. The argument uses identities for exchangeable pairs constructed by resampling individual matrices, together with a concentration inequality for sums of the approximating variables.

math.PR↗

Normal approximation for total magnetization in subcritical long-range Ising models

We establish Berry--Esseen bounds and 1-Wassershtein bounds for the total spin of strictly subcritical zero-field Ising models with summable interactions. Let $J:\mathbb Z^d\to[0,\infty)$ be symmetric, satisfy $J(0)=0$, and $\|J\|_1:=\sum_{x\in\mathbb Z^d}J(x)<\infty$. For a nonempty finite set $Λ\subset\mathbb Z^d$, consider zero-field Gibbs measure with free boundary conditions, in which a spin configuration $σ\in\{-1,+1\}^Λ$ has probability proportional to \[ \exp\!\left\{ β\sum_{x,y\inΛ} J(x-y)σ_xσ_y \right\}. \] Let $S_Λ:=\sum_{x\inΛ}σ_x$ be the total spin and $β_{\mathrm c}$ denote the critical inverse temperature. For every fixed $0\leqβ<β_{\mathrm c}$, we prove that \[ d_{\mathrm K}\!\left( \frac{S_Λ}{\sqrt{\operatorname{Var}(S_Λ)}},G \right) \leq C_{β,J}|Λ|^{-1/2}, \] where $d_{\mathrm K}$ is the Kolmogorov distance, $G\sim \mathcal{N}(0,1)$, and $C_{β,J}$ depends only on $β$ and $J$. For the fully periodized model on $(\mathbb Z/L\mathbb Z)^d$, the corresponding rate is $L^{-d/2}$, uniformly in $L$. For the classical nearest-neighbor model, the Kolmogorov bound also holds for $-β_{\mathrm c}<β<β_{\mathrm c}$, covering both ferromagnetic and antiferromagnetic interactions. We also obtain $1$-Wasserstein bounds with the same rates in the respective subcritical regimes. Both the Kolmogorov and $1$-Wasserstein bounds hold with the same rate under the corresponding infinite-volume free-boundary Gibbs measures.

math.PR↗

Sharp Cramér-type moderate deviation bounds for the self-normalized maximum of partial sums

Let $X_1,X_2,\ldots$ be i.i.d. random variables with zero mean and variance $σ^2\in(0,\infty)$. In this paper, we establish a sharp Cramér-type moderate deviation for the self-normalized maximum of partial sums under a finite $p$-th absolute moment, $2<p\le3$. In particular, we show that $\mathbb{P}(M_n\ge xV_n)=2(1-Φ(x))\{1+O(1)β_{n,p}(1+x)^p\}$ for $0\le x\leβ_{n,p}^{-1/p}$, where $M_n=\max_{1\le k\le n}\sum_{j=1}^kX_j$, $V_n=(\sum_{j=1}^nX_j^2)^{1/2}$, $β_{n,p}=\mathbb{E}|X_1|^p/(n^{(p-2)/2}σ^p)$, and $Φ$ is the standard normal distribution function. This proves a conjecture of Shao2010. More precisely, we bound the relative error by the same truncated-moment quantity as for self-normalized sums. The proof compares the maximum with the absolute sum while preserving their common denominator, through a reflected-walk representation and Fourier estimates with distribution-adapted smoothing.

math.PR↗

The Central Limit Theorem and Berry--Esseen bound for logarithmic law of random determinants

Let $A=(A_n)_{n\ge2}$ be a triangular array of random matrices, where $A_n=(a_{ij})_{1\le i,j\le n}$ is an $n\times n$ random matrix with independent real entries satisfying $\mathbb E a_{ij}=0$ and $\mathbb Ea_{ij}^2=1$, and put $\mathcal L_n=\log|\det A_n|$ and \[ W_n^{\mathrm d}(A_n):=\frac{\mathcal L_n - \frac12\log(n-1)!}{\sqrt{\frac12\log n}},\quad W_n^{\mathrm e}(A_n):= \frac{\mathcal L_n-\mathbb E \mathcal L_n}{\sqrt{\frac12\log n}}. \] We prove that $W_n^{\mathrm d}(A_n) \Rightarrow \mathcal N(0,1)$, whenever the family $\left\{\frac{|a_{ij}|^{4}}{\sqrt{\log(e+|a_{ij}|)}} \right\}_{n\geq 2;1\leq i,j\leq n}$ is uniformly integrable. If, in addition, the entries have uniformly bounded densities, then $W_n^{\mathrm e}(A_n) \Rightarrow \mathcal N(0,1)$ whenever the family $\left\{\frac{|a_{ij}|^{4}}{\log(e+|a_{ij}|)}\right\}_{n\geq 2;1\leq i,j\leq n} $ is uniformly integrable. These two conditions are optimal at the level of universal moment assumptions. We further establish the corresponding Berry--Esseen bounds, and show that for $0<δ\le\tfrac12$, if $\sup\limits_{n}\max\limits_{1\le i,j\le n}\mathbb E \frac{|a_{ij}|^4} {\{\log(e+|a_{ij}|)\}^{1/2-δ}}<\infty$, then \begin{align*} d_{\mathrm K}(W_n^{\mathrm d}(A_n),\mathcal N(0,1))\le C(\log n)^{-δ}. \end{align*} For $0<γ\le1$, if $\sup\limits_{n}\max\limits_{1\le i,j\le n}\mathbb E \frac{|a_{ij}|^4} {\{\log(e+|a_{ij}|)\}^{1-γ}}<\infty$ and the entries have uniformly bounded densities, then \begin{align*} d_{\mathrm K}(W_n^{\mathrm e}(A_n),\mathcal N(0,1))\le C(\log n)^{-γ}. \end{align*} When $δ= 1/2$ and $γ= 1$, the bounds $(\log n)^{-1/2}$ and $(\log n)^{-1}$ are optimal, respectively. Our results improve the earlier Central Limit Theorem by \cite{BaoPanZhou2015} and the Berry--Esseen bound by \cite{NguyenVu2014}.

math.PR↗

Critical-Window Fluctuations and Disorder Universality for the Sherrington--Kirkpatrick Model

We establish free-energy fluctuation limits for the Ising Sherrington--Kirkpatrick model in the nonzero parts of its critical window. For fixed $b\ne0$ and $β_N=1+bN^{-1/3}\sqrt{\log N}$, our main Gaussian orthogonal ensemble (GOE) result is \[ \sqrt{\frac6{\log N}}\left(F_{N,β_N}-N\,\mathrm{FE}(β_N)+\frac{\log N}{12}\right)\xrightarrow{d}G+\sqrt{\frac32}\,b_+TW_1, \] where $G$ is standard Gaussian, $TW_1$ has the real Tracy--Widom law, and $G$ is independent of $TW_1$, and $\mathrm{FE}$ denotes the limit of spherical Sherrington--Kirkpatrick free-energy. Additionally, we show that in a moderately supercritical regime \[ \frac{2}{N^{1/3}(β_N-1)}\left(F_{N,β_N}-N\,\mathrm{FE}(β_N)+\frac{\log N}{12}\right)\xrightarrow{d}TW_1. \] We also show that the above results remains valid for independent, not necessarily identically distributed, disorder matrices whose first three moments match the Gaussian law and whose fourth moments satisfy an averaged bound.

math.PR↗

Gaussian Approximation and Multiplier Bootstrap for Stochastic Gradient Descent

In this paper, we establish the non-asymptotic validity of the multiplier bootstrap procedure for constructing the confidence sets using the Stochastic Gradient Descent (SGD) algorithm. Under appropriate regularity conditions, our approach avoids the need to approximate the limiting covariance of Polyak-Ruppert SGD iterates, which allows us to derive approximation rates in convex distance of order up to $1/\sqrt{n}$. Notably, this rate can be faster than the one that can be proven in the Polyak-Juditsky central limit theorem. To our knowledge, this provides the first fully non-asymptotic bound on the accuracy of bootstrap approximations in SGD algorithms. Our analysis builds on the Gaussian approximation results for nonlinear statistics of independent random variables.

stat.ML↗

Refined Berry-Esseen bounds under local dependence

In this paper, we establish Berry--Esseen bounds for both self-normalized and non-self-normalized sums of locally dependent random variables. The proofs are based on Stein's method together with a concentration inequality approach. We develop a new class of concentration inequalities that extend classical results and achieve optimal convergence rates under more general dependence structures. As applications, we apply our main results to derive sharper Berry--Esseen bounds for graph dependency, distributed $U$-statistics, constrained $U$-statistics, and decorated injective homomorphism sums.

math.PR↗

Improved Central Limit Theorem and Bootstrap Approximations for Linear Stochastic Approximation

In this paper, we refine the Berry-Esseen bounds for the multivariate normal approximation of Polyak-Ruppert averaged iterates arising from the linear stochastic approximation (LSA) algorithm with decreasing step size. We consider the normal approximation by the Gaussian distribution with covariance matrix predicted by the Polyak-Juditsky central limit theorem and establish the rate up to order $n^{-1/3}$ in convex distance, where $n$ is the number of samples used in the algorithm. We also prove a non-asymptotic validity of the multiplier bootstrap procedure for approximating the distribution of the rescaled error of the averaged LSA estimator. We establish approximation rates of order up to $1/\sqrt{n}$ for the latter distribution, which significantly improves upon the previous results obtained by Samsonov et al. (2024).

stat.ML↗

Another look at Stein's method for Studentized nonlinear statistics with an application to U-statistics

We take another look at using Stein's method to establish uniform Berry-Esseen bounds for Studentized nonlinear statistics, highlighting variable censoring and an exponential randomized concentration inequality for a sum of censored variables as the essential tools to carry the arguments involved. As an important application, we prove a uniform Berry-Esseen bound for Studentized U-statistics in a form that exhibits the dependence on the degree of the kernel.

math.ST↗

Normal approximation for exponential random graphs

The question of whether the central limit theorem (CLT) holds for the total number of edges in exponential random graph models (ERGMs) in the subcritical region of parameters has remained an open problem. In this paper, we establish the CLT. As a result of our proof, we also derive a convergence rate for the CLT, an explicit formula for the asymptotic variance, and the CLT for general subgraph counts. To establish our main result, we develop Stein's method for the normal approximation of general functionals of nonlinear exponential families of random variables, which is of independent interest. In addition to ERGMs, our general theorem can also be applied to other models. A key ingredient needed in our proof for the ERGM is a higher-order concentration inequality, which was known in a subset of the subcritical region called Dobrushin's uniqueness region. We use Stein's method to partially generalize such inequalities to the subcritical region.

math.PR↗

Gaussian Approximation and Multiplier Bootstrap for Polyak-Ruppert Averaged Linear Stochastic Approximation with Applications to TD Learning

In this paper, we obtain the Berry-Esseen bound for multivariate normal approximation for the Polyak-Ruppert averaged iterates of the linear stochastic approximation (LSA) algorithm with decreasing step size. Moreover, we prove the non-asymptotic validity of the confidence intervals for parameter estimation with LSA based on multiplier bootstrap. This procedure updates the LSA estimate together with a set of randomly perturbed LSA estimates upon the arrival of subsequent observations. We illustrate our findings in the setting of temporal difference learning with linear function approximation.

stat.ML↗

Self-Normalized Moderate Deviations for Degenerate U-Statistics

In this paper, we study self-normalized moderate deviations for degenerate { $U$}-statistics of order $2$. Let $\{X_i, i \geq 1\}$ be i.i.d. random variables and consider symmetric and degenerate kernel functions in the form $h(x,y)=\sum_{l=1}^{\infty} λ_l g_l (x) g_l(y)$, where $λ_l > 0$, $E g_l(X_1)=0$, and $g_l (X_1)$ is in the domain of attraction of a normal law for all $l \geq 1$. Under the condition $\sum_{l=1}^{\infty}λ_l<\infty$ and some truncated conditions for $\{g_l(X_1): l \geq 1\}$, we show that $ \text{log} P({\frac{\sum_{1 \leq i \neq j \leq n}h(X_{i}, X_{j})} {\max_{1\le l<\infty}λ_l V^2_{n,l} }} \geq x_n^2) \sim - { \frac {x_n^2}{ 2}}$ for $x_n \to \infty$ and $x_n =o(\sqrt{n})$, where $V^2_{n,l}=\sum_{i=1}^n g_l^2(X_i)$. As application, a law of the iterated logarithm is also obtained.

math.PR↗

Nonuniform Berry-Esseen bounds for Studentized U-statistics

We establish nonuniform Berry-Esseen (B-E) bounds for Studentized U-statistics of the rate $1/\sqrt{n}$ under a third-moment assumption, which covers the t-statistic that corresponds to a kernel of degree $1$ as a special case. While an interesting data example raised by Novak (2005) can show that the form of the nonuniform bound for standardized U-statistics is actually invalid for their Studentized counterparts, our main results suggest that, the validity of such a bound can be restored by minimally augmenting it with an additive correction term that decays exponentially in $n$. To our best knowledge, this is the first time that valid nonuniform B-E bounds for Studentized U-statistics have appeared in the literature.

math.ST↗

Self-normalized Cramér type moderate deviations for martingales and applications

Cramér's moderate deviations give a quantitative estimate for the relative error of the normal approximation and provide theoretical justifications for many estimator used in statistics. In this paper, we establish self-normalized Cramér type moderate deviations for martingales under some mile conditions. The result extends an earlier work of Fan, Grama, Liu and Shao [Bernoulli, 2019]. Moreover, applications of our result to Student's statistic, stationary martingale difference sequences and branching processes in a random environment are also discussed. In particular, we establish Cramér type moderate deviations for Student's $t$-statistic for branching processes in a random environment.

math.PR↗

Cramér's moderate deviations for martingales with applications

Let $(ξ_i,\mathcal{F}_i)_{i\geq1}$ be a sequence of martingale differences. Set $X_n=\sum_{i=1}^n ξ_i $ and $ \langle X \rangle_n=\sum_{i=1}^n \mathbf{E}(ξ_i^2|\mathcal{F}_{i-1}).$ We prove Cramér's moderate deviation expansions for $\displaystyle \mathbf{P}(X_n/\sqrt{\langle X\rangle_n} \geq x)$ and $\displaystyle \mathbf{P}(X_n/\sqrt{ \mathbf{E}X_n^2} \geq x)$ as $n\to\infty.$ Our results extend the classical Cramér result to the cases of normalized martingales $X_n/\sqrt{\langle X\rangle_n}$ and standardized martingales $X_n/\sqrt{ \mathbf{E}X_n^2}$, with martingale differences satisfying the conditional Bernstein condition. Applications to elephant random walks and autoregressive processes are also discussed.

math.PR↗

A probability approximation framework: Markov process approach

We view the classical Lindeberg principle in a Markov process setting to establish a probability approximation framework by the associated Itô's formula and Markov operator. As applications, we study the error bounds of the following three approximations: approximating a family of online stochastic gradient descents (SGDs) by a stochastic differential equation (SDE) driven by multiplicative Brownian motion, Euler-Maruyama (EM) discretization for multi-dimensional Ornstein-Uhlenbeck stable process, and multivariate normal approximation. All these error bounds are in Wasserstein-1 distance.

math.PR↗