arXiv ScienceSearch

arXiv subjects

Liu-Quan Yao

Publications and source records attributed to Liu-Quan Yao.

4 recordsLinked to original sources

Conditional Fisher-Information Central Limit Theorems under Log-Concavity with Information-Theoretic Consequences

We establish conditional central limit theorems in Fisher information under log-concavity in every fixed dimension. For conditionally centered normalized sums, after whitening by the averaged conditional covariance, the averaged conditional Fisher information converges to the dimension if and only if it is finite at one convolution level. The scalar criterion follows as the one-dimensional case; we also provide an independent scalar proof based on a second-order continuity theorem for Fisher production on Gaussian-smoothed, tail-controlled classes. For the original sums, the averaged Fisher information matrix converges in operator norm to the inverse averaged conditional covariance. Consequently, the conditional relative Fisher information with respect to the limiting Gaussian law vanishes, and the Gaussian logarithmic Sobolev inequality yields convergence in conditional relative entropy and conditional entropy. We give two operational consequences. For any fixed finite-constellation low-power input, the first-order conditional mutual-information slope converges to the Gaussian-noise benchmark. For Gaussian signaling at any fixed signal covariance, the mutual-information gap from that benchmark is bounded by the conditional relative Fisher deficit and hence vanishes asymptotically.

cs.IT

A Finite-Entropy Criterion for the Entropic Conditional Central Limit Theorem

We prove a finite-entropy criterion for the entropic conditional central limit theorem. Let $(\xi_i,\eta_i)_{i\geq 1}$ be independent copies of a pair $(\xi,\eta)$, and set $W_n=n^{-1/2}\sum_{i=1}^n \xi_i$ and $\boldsymbol{\eta}_n=(\eta_1,\ldots,\eta_n)$. Under the assumptions that $\mathbb{E}\operatorname{Var}(\xi\mid\eta)<\infty$ and that the conditional law of $\xi$ given $\eta$ is absolutely continuous almost surely, we show that $\mathbb{E}h(W_n\mid\boldsymbol{\eta}_n)$ converges to the Gaussian entropy $\frac12\log(2\pi e\sigma^2)$, where $\sigma^2=\mathbb{E}\operatorname{Var}(\xi\mid\eta)$, if and only if $\mathbb{E}h(W_{n_0}\mid\boldsymbol{\eta}_{n_0})>-\infty$ for some $n_0$. The main technical ingredient is a continuity theorem for Fisher information under Gaussian smoothing, which allows us to replace the finite expected conditional Fisher-information assumption by a necessary and sufficient finite-entropy condition.

math.PR

Symmetric KL-divergence by Stein's Method

In this paper, we consider the symmetric KL-divergence between the sum of independent variables and a Gaussian distribution, and obtain a convergence rates of order $O\left( \frac{\ln n}{\sqrt{n}}\right)$. The proof is based on Stein's method. The convergence rate of order $O\left( \frac{1}{\sqrt{n}}\right)$ and $O\left( \frac{1}{n}\right) $ are also obtained under higher moment condition.

math.PR

Entropic Conditional Central Limit Theorem and Hadamard Compression

We make use of an entropic property to establish a convergence theorem (Main Theorem), which reveals that the conditional entropy measures the asymptotic Gaussianity. As an application, we establish the {\it entropic conditional central limit theorem} (CCLT), which is stronger than the classical CCLT. As another application, we show that continuous input under iterated Hadamard transform, almost every distribution of the output conditional on the values of the previous signals will tend to Gaussian, and the conditional distribution is in fact insensitive to the condition. The results enable us to make a theoretic study concerning Hadamard compression, which provides a solid theoretical analysis supporting the simulation results in previous literature. We show also that the conditional Fisher information can be used to measure the asymptotic Gaussianity.

math.PR