arXiv Science⌕ Search

arXiv subjects

Wang Zhou

Publications and source records attributed to Wang Zhou.

At least 19 recordsLinked to original sources

When is Hotelling's $T^2$ asymptotically $F$-distributed?

For Gaussian observations, a deterministic multiple of Hotelling's $T^2$ statistic has an exact $F$ distribution. This paper investigates when this approximation remains valid for an independent and identically distributed (i.i.d.) data matrix $\mathbf{X}\in \mathbb{R}^{p\times n}$ with a fixed, possibly heavy-tailed entry law $ξ$. Under symmetry and $\limsup_{n\rightarrow \infty} p/n<1$, we prove that approximation by the $F$ distribution in Kolmogorov distance is equivalent to belonging to the domain of attraction of the normal law. Both conditions are equivalent to relative concentration of the diagonal entries of the null-space projection $\mathbf{P}=\mathbf{I}_n-\mathbf{X}^{\top}(\mathbf{X}\mathbf{X}^{\top})^{-1}\mathbf{X}$. The central quantity $R=\mathbf{1}^{\top}\mathbf{P}\mathbf{1}$ measures the geometric alignment between the averaging direction and the random row space of $\mathbf{X}$. For symmetric finite-variance entries, the sufficient approximation extends to every sequence $1\le p x)=0$ when $p/n\rightarrow γ\in (0,1)$, and obtain the $F$ approximation as a consequence. Centered standardized Pareto laws show that the exponent $5/2$ is sharp for this universal absolute-tail sufficient condition, although balanced-tail nonsymmetric laws can retain the approximation at the boundary, which reveals that the asymmetry of the tails matters for the $F$ approximation.

math.ST↗

Optimal normal approximation for symmetric statistics

Rates of convergence in normal approximation are fundamental to probability and statistics. The theory has evolved from normalized sums to Studentized statistics, smooth functions of sample means, and $U$-statistics, and more generally to symmetric statistics. A central question throughout this development has been to identify the weakest assumptions under which optimal rates of convergence can be established. First, in this paper we address this question by establishing optimal bounds for adjusted normal approximations of symmetric statistics based on independent and identically distributed observations. More precisely, we bound the Kolmogorov error by a very neat sum of the classical third-moment term and the variance of the remainder term. This resolves a long-standing conjecture posed by Bentkus, Jing and Zhou (\textit{Ann. Probab.} \textbf{37} (2009), 2174--2199). Secondly, we establish the optimal Berry-Esseen rate for jackknife Studentized \(U\)-statistics of order two under minimal conditions, i.e., a finite third absolute moment of the first projection and a finite \(5/3\)-absolute moment of the canonical kernel. This resolves a long-standing conjecture in classical probability theory. Our proofs combine signed Prawitz smoothing with a conditional-variance submartingale, polynomial approximation, and a bounded change of measure.

math.PR↗

Optimal Personalized Subspace Learning for Multi-view Tensor Observations

In this work, we model the observed multi-view tensors by decomposing the underlying signal in each view into two components: (i) the shared component that captures common dynamics across all views, and (ii) the private component that accounts for view-wise unique variations. To decouple the shared and private components, we introduce a novel Tucker personalized subspace principal component analysis (TPS-PCA) approach for tensors, which admits a one-step closed-form solution and serves as an ideal surrogate for our extended tensor-version personalized PCA (TP-PCA), adapted from the seminal work by \cite{shi2024personalized}. The theoretical analysis reveals that the proposed TPS-PCA estimators reach the minimax lower bound in terms of view-wise tensor decoupling, whereas the TP-PCA estimators only achieve a rate of average decoupling error across views, which is still slower than that of the TPS-PCA estimators. Extensive numerical experiments are conducted on synthetic and real datasets, demonstrating the wide applicability of the proposed method in fields including power management, financial analysis, and activity recognition.

stat.ME↗

An Exact Strip Observable and the Half-Plane One-Arm Probability for Critical Bond Percolation on the Square Lattice

We prove the half-plane one-arm exponent for critical Bernoulli bond percolation on the square lattice. Ikhlef and Ponsaing obtained an exact formula for the probability that the unique infinite percolation hull running along an odd-width strip passes through a prescribed boundary edge. Their interpolation, however, treats a rational function as a polynomial. We clear the full denominator, prove a coordinatewise Laurent-degree bound directly at $q^3=1$, and establish the exact strip formula from the deletion relations. At the homogeneous point, the qKZ expression is the Bernoulli probability of this boundary-passage event. A finite local modification, the RSW theorem, and one-arm quasi-multiplicativity then give, uniformly for $1\le r<R$, ${\bf P}_{1/2}(A_1^+(r,R))\asymp (r/R)^{1/3}$.

math.PR↗

Phase transition for the smallest eigenvalue of high-dimensional sample correlation matrices

We study the smallest nonzero eigenvalue of the sample correlation matrix $\mathbf{R}_n$ formed from a $p_n \times n$ data matrix with i.i.d. real entries $ξ$ of mean zero and unit variance, in the high-dimensional regime $p_n / n \to ϕ\in (0, \infty) \setminus \{1\}$. In the tall regime $ϕ> 1$, we prove almost-sure convergence of $λ_n (\mathbf{R}_n)$ to the lower Marčenko--Pastur edge $λ_- = (1 - \sqrtϕ)^2$ without additional moment assumptions. In the wide regime $ϕ< 1$, we establish a phase transition at the third-order tail scale. If $t^3 \mathbb{P}\{\lvert ξ\rvert > t\} \to 0$ as $t \to \infty$, the smallest eigenvalue $λ_{p_n} (\mathbf{R}_n)$ converges in probability to $λ_-$. While if $t^3 \mathbb{P}\{\lvert ξ\rvert > t\} \to \infty$, then $λ_{p_n} (\mathbf{R}_n)$ converges in probability to zero. At the critical scale $t^3 \mathbb{P}\{\lvert ξ\rvert > t\} \to κ\in (0, \infty)$, the point process of eigenvalues in the lower gap $(0, λ_-)$ converges in distribution to a Poisson random measure with explicit intensity. In this critical regime, we also identify the nondegenerate limiting distribution of $λ_{p_n} (\mathbf{R}_n)$, which has a continuous density on $(0, λ_-)$ and a positive atom at $λ_-$.

math.PR↗

WDL-OPD: Weak-Driven On-Policy Distillation via Mixture-Constrained Co-Training

On-policy distillation (OPD) aligns a student with a teacher on trajectories sampled from the student itself, reducing the train-test state mismatch of offline distillation. The same feedback loop can nevertheless be unstable: each update changes both the policy and the states on which the next update is computed. We introduce WDL-OPD, a mixture-constrained co-training method with two trainable policies. An anchor policy generates every rollout, an auxiliary policy evaluates the same visited states, and a geometric mixture of their token distributions is matched to a frozen teacher by reverse KL. Both policies receive gradient. We show that freezing the auxiliary recovers an anchor-plus-contrast proxy target closely related to OPD$^2$ and W2S-OPD, whereas joint training creates branch-level degrees of freedom that a static delta cannot express. In recorded Qwen3 experiments at 1.7B and 4B scale, WDL-OPD produces the strongest student checkpoint in each of four scale-domain settings. It raises MATH500 accuracy from 0.630 to 0.685 at 4B and from 0.521 to 0.585 at 1.7B. In code generation, seven single-policy OPD configurations exhibit entropy growth or trajectory degradation, while co-training reaches independently re-evaluated development scores of 0.637 and 0.375. Because several comparisons differ in curriculum or initialization, these results support a stabilization hypothesis rather than a universal causal claim. We provide the exact training algorithm, failure evidence, and the controlled comparison matrix needed to test that hypothesis.

cs.LG↗

Spectral Analysis of Gram Matrices with Missing at Random Observations: Convergence, Central Limit Theorems, and Applications in Statistical Inference

Motivated by the statistical inference using the Gram matrix in the context of missing at random observations, this paper investigates the spectral properties of the random matrices $\mb S_n=\frac{1}{n}\mb Z\mb Z^*$, where $\mb Z=\mb D\circ(\boldsymbol{Σ^{1/2}}\mb X)$ represents a Hadamard random matrix with entries determined by independent Bernoulli variables $\mb D$. Operating within the high-dimensional framework, we establish the convergence of the empirical spectral distribution of $\mb S_n$ to a well-defined limiting distribution. In addition, we explore the impact of the missing mechanism on the second-order properties of the spectral distribution of the Gram matrix $\mathbf{S}_n$. We establish the central limit theorem for the linear spectral statistics of $\mathbf{S}_n$, shedding light on their fluctuations. Surprisingly, our analysis reveals that even in the ideal Gaussian distribution scenario, the fluctuations of statistics generated by eigenvalues are influenced by the eigenvectors of the population covariance matrix in the missing-at-random case. This discovery uncovers a remarkable phenomenon that starkly contrasts with the classical case. Subsequently, we demonstrate the practical application of our central limit theorem in hypothesis testing for the population covariance matrix.

math.ST↗

Functional Limit Theorems for Random Least Common Multiples

Let $A_n$ be a subset of $\{1,2,\ldots,n\}$ obtained by retaining each integer independently with fixed probability $θ\in(0,1)$, and let $L_n$ be the least common multiple of the integers in $A_n$. We prove a functional large deviation principle, a functional moderate deviation principle, and a Strassen-type functional law of the iterated logarithm for the process $(\log L_{\lfloor{nt}\rfloor})_{0\le t\le1}$. The large deviation rate function is given by an entropy contraction for geometric marks, while the moderate deviation rate function and LIL cluster set are described by the reproducing kernel Hilbert space associated with the Gaussian limit process.

math.PR↗

Empirical Characteristic Function Method for Leverage Effect and Volatility of Volatility: Estimation and Feasible Inference

We develop jump-robust estimators of the leverage effect and volatility of volatility using high-frequency data. Our construction begins with a spot volatility estimator based on the empirical characteristic function of high-frequency increments. This method can mitigate the contamination from jumps, which can be of infinite variation. We then construct estimators of the leverage effect and volatility of volatility and correct for the bias induced by spot volatility estimation. We establish consistency and central limit theorems under conditions that allow greater jump activity than existing methods. We also develop consistent estimators of the asymptotic variances, making the limiting results feasible for statistical inference. Simulation studies demonstrate the improved finite-sample performance of the proposed estimators, particularly in the presence of infinite variation jumps. An empirical application provides evidence of nonzero leverage effect and volatility of volatility, when the jump activity is intensive.

stat.ME↗

Weak-Driven Learning: How Weak Agents make Strong Agents Stronger

As post-training optimization becomes central to improving large language models, we observe a persistent saturation bottleneck: once models grow highly confident, further training yields diminishing returns. While existing methods continue to reinforce target predictions, we find that informative supervision signals remain latent in models' own historical weak states. Motivated by this observation, we propose WMSS (Weak Agents Can Make Strong Agents Stronger), a post-training paradigm that leverages weak checkpoints to guide continued optimization. By identifying recoverable learning gaps via entropy dynamics and reinforcing them through compensatory learning, WMSS enables strong agents to improve beyond conventional post-training saturation. Experiments on mathematical reasoning and code generation datasets show that agents trained with our approach achieve effective performance improvements, while incurring zero additional inference cost.

cs.AI↗

The Geometry of Spectral Fluctuations: On Near-Optimal Conditions for Universal Gaussian CLTs, with Statistical Applications

We study linear spectral statistics of high dimensional sample covariance matrices in a regime where the empirical spectral distribution remains governed by the classical sample covariance law but the fluctuation theory is nonclassical. Our starting point is a decomposition of the covariance of centered quadratic forms into a universal Gaussian part and a model dependent fourth order correction. This leads to an abstract framework, termed GHOST, for universal Gaussian central limit theorems under structured fourth order effects. Under this framework, we prove a Gaussian central limit theorem for linear spectral statistics, with explicit mean and covariance corrections determined by a bilinear fourth order kernel. Boundary examples show that the conditions are close to necessary for a broad universal Gaussian closure. We then develop a blockwise mixed radial model that verifies the abstract assumptions and makes the correction explicit. The correction splits into an entrywise fourth moment component and a lockwise energy fluctuation component. The latter may change the fluctuation scale, leading to a phase transition at the level of fluctuations. As an application, we study sphericity testing. Under the spherical null, the general correction collapses to a single scalar parameter, yielding a feasible data driven correction of John's test.

math.ST↗

ALADIN:Attribute-Language Distillation Network for Person Re-Identification

Recent vision-language models such as CLIP provide strong cross-modal alignment, but current CLIP-guided ReID pipelines rely on global features and fixed prompts. This limits their ability to capture fine-grained attribute cues and adapt to diverse appearances. We propose ALADIN, an attribute-language distillation network that distills knowledge from a frozen CLIP teacher to a lightweight ReID student. ALADIN introduces fine-grained attribute-local alignment to establish adaptive text-visual correspondence and robust representation learning. A Scene-Aware Prompt Generator produces image-specific soft prompts to facilitate adaptive alignment. Attribute-local distillation enforces consistency between textual attributes and local visual features, significantly enhancing robustness under occlusions. Furthermore, we employ cross-modal contrastive and relation distillation to preserve the inherent structural relationships among attributes. To provide precise supervision, we leverage Multimodal LLMs to generate structured attribute descriptions, which are then converted into localized attention maps via CLIP. At inference, only the student is used. Experiments on Market-1501, DukeMTMC-reID, and MSMT17 show improvements over CNN-, Transformer-, and CLIP-based methods, with better generalization and interpretability.

cs.CV↗

Inference for Spiked Eigenstructure under Generalized Covariance and Correlation Models

In high-dimensional principal component analysis, important inferential targets include both leading spikes and the associated principal eigenspaces. Such problems arise naturally in high-dimensional factor models, where leading principal directions are interpreted as dominant loading directions and spike magnitudes reflect the strength of the corresponding common factors. We study inference based on the sample covariance matrix $\bS$ and the sample correlation matrix $\widehat{\bR}$ under generalized spiked models with arbitrary bulk spectrum. We establish almost sure limits and central limit theorems for spiked sample eigenvalues, and derive asymptotic distributions for functionals of sample spiked eigenspaces. Building on this theory, we develop procedures for one-sample inference for benchmark principal directions and for two-sample comparison of leading spike strengths across populations. Even in the covariance setting, our results substantially extend the existing literature by allowing a non-identity bulk structure. A real-data analysis on stock returns further illustrates the practical relevance of the proposed procedures, showing that covariance-based and correlation-based PCA can lead to markedly different conclusions.

math.ST↗

The logarithmic law of sample correlation matrices

Let $\mathbf{R}$ be the sample correlation matrix constructed from $\mathbf{X}\in \mathbb{R}^{p\times n}$, whose entries are independent and identically distributed random variables with mean zero and tail probability condition $\lim_{x\rightarrow \infty}x^3\mathbb{P}(|ξ|>x)=0$. We derive the universal logarithmic law for $\log \det \mathbf{R}$, \begin{equation*} \frac{\log \det \mathbf{R}-(p-n+1/2)\log (1-\frac{p-1}{n})+p-\frac{p}{n}}{\sqrt{-2\log (1-\frac{p-1}{n})-2\frac{p}{n}}}\stackrel{d}{\rightarrow} {N}(0,1), \end{equation*} if $p\le n$ as $p,n\rightarrow \infty$. Moreover, under the near-singularity case $0\le n-p\le n^{1-w}$ for any $w\in (0,1)$, it is shown that the tail probability condition can be weakened to $\lim_{x\rightarrow \infty}x^3(\log x)^{-1/4+\mathfrak{c}}\mathbb{P}(|ξ|>x)<\infty$ for any constant $0<\mathfrak{c}<1/4$.

math.PR↗

Spectral analysis of high-dimensional spot volatility matrix with applications

In random matrix theory, the spectral distribution of the covariance matrix has been well studied under the large dimensional asymptotic regime when the dimensionality and the sample size tend to infinity at the same rate. However, most existing theories are built upon the assumption of independent and identically distributed samples, which may be violated in practice. For example, the observational data of continuous-time processes at discrete time points, namely, the high-frequency data. In this paper, we extend the classical spectral analysis for the covariance matrix in large dimensional random matrix to the spot volatility matrix by using the high-frequency data. We establish the first-order limiting spectral distribution and obtain a second-order result, that is, the central limit theorem for linear spectral statistics. Moreover, we apply the results to design some feasible tests for the spot volatility matrix, including the identity and sphericity tests. Simulation studies justify the finite sample performance of the test statistics and verify our established theory.

math.ST↗

The Spurious Factor Dilemma: Robust Inference in Heavy-Tailed Elliptical Factor Models

Standard methods for determining the number of factors often overestimate the true number when data exhibit heavy-tailed randomness, misinterpreting noise-induced outliers as genuine factors. This paper addresses this challenge within the framework of Elliptical Factor Models (EFM), which accommodate both heavy tails and potential non-linear dependencies common in real-world data. We demonstrate, both theoretically and empirically, that heavy-tailed noise generates spurious eigenvalues that mimic true factor signals. To distinguish these, we propose a novel methodology based on a fluctuation magnification algorithm. Under mild conditions, we show that, by magnifying perturbations, the eigenvalues associated with real factors exhibit significantly less fluctuation (stabilizing asymptotically) than spurious eigenvalues arising from heavy-tailed effects. We develop a formal testing procedure based on this principle and apply it to the problem of accurately selecting the number of common factors in heavy-tailed EFMs. Simulation studies and real data analysis confirm the effectiveness of our approach, particularly in scenarios with pronounced heavy-tailedness.

stat.ME↗

LLMBoost: Make Large Language Models Stronger with Boosting

Ensemble learning of LLMs has emerged as a promising alternative to enhance performance, but existing approaches typically treat models as black boxes, combining the inputs or final outputs while overlooking the rich internal representations and interactions across models.In this work, we introduce LLMBoost, a novel ensemble fine-tuning framework that breaks this barrier by explicitly leveraging intermediate states of LLMs. Inspired by the boosting paradigm, LLMBoost incorporates three key innovations. First, a cross-model attention mechanism enables successor models to access and fuse hidden states from predecessors, facilitating hierarchical error correction and knowledge transfer. Second, a chain training paradigm progressively fine-tunes connected models with an error-suppression objective, ensuring that each model rectifies the mispredictions of its predecessor with minimal additional computation. Third, a near-parallel inference paradigm design pipelines hidden states across models layer by layer, achieving inference efficiency approaching single-model decoding. We further establish the theoretical foundations of LLMBoost, proving that sequential integration guarantees monotonic improvements under bounded correction assumptions. Extensive experiments on commonsense reasoning and arithmetic reasoning tasks demonstrate that LLMBoost consistently boosts accuracy while reducing inference latency.

cs.LG↗

A new non-parametric Kendall's tau for matrix-valued elliptical observations

In this article, we first propose generalized row/column matrix Kendall's tau for matrix-variate observations that are ubiquitous in areas such as finance and medical imaging. For a random matrix following a matrix-variate elliptically contoured distribution, we show that the eigenspaces of the proposed row/column matrix Kendall's tau coincide with those of the row/column scatter matrix respectively, with the same descending order of the eigenvalues. We perform eigenvalue decomposition to the generalized row/column matrix Kendall's tau for recovering the loading spaces of the matrix factor model. We also propose to estimate the pair of the factor numbers by exploiting the eigenvalue-ratios of the row/column matrix Kendall's tau. Theoretically, we derive the convergence rates of the estimators for loading spaces, factor scores and common components, and prove the consistency of the estimators for the factor numbers without any moment constraints on the idiosyncratic errors. Thorough simulation studies are conducted to show the higher degree of robustness of the proposed estimators over the existing ones. Analysis of a financial dataset of asset returns and a medical imaging dataset associated with COVID-19 illustrate the empirical usefulness of the proposed method.

stat.ME↗