A One-Sided McDiarmid-Type Inequality for Heavy Tails via Reverse KL Tensorization

Hanuka Eshima; Amedeo Roberto Esposito; Andrea Paudice

Home/Archive/arXiv

arXiv · 2610.21103

A One-Sided McDiarmid-Type Inequality for Heavy Tails via Reverse KL Tensorization

Hanuka Eshima·Amedeo Roberto Esposito·Andrea Paudice

View original source ↗Read source document ↗Export metadata ↓

Abstract

We revisit McDiarmid's inequality, a central tool in statistical learning theory and algorithm analysis. We show that large deviations above the mean are exponentially unlikely for functions of independent random variables that are almost surely bounded above and satisfy a conditional moment assumption of order $p\in(1,2]$. When $p<2$, the result applies even when the function has infinite variance. Our proof relies on a new tensorization inequality for the Kullback--Leibler divergence, termed reverse KL tensorization, which may be of independent interest. Applications include concentration of the sample mean and median-of-means estimator, and one-sided uniform risk bounds for unbounded losses.

Explore related subjects

math.ST cs.IT math.IT math.PR stat.ML stat.TH

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Hanuka Eshima, Amedeo Roberto Esposito, Andrea Paudice. 2026-10-15. A One-Sided McDiarmid-Type Inequality for Heavy Tails via Reverse KL Tensorization. https://arxiv.org/abs/2610.21103

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

A proximal gradient algorithm for composite log-concave sampling

We propose an algorithm to sample from composite log-concave distributions over $\mathbb{R}^d$, i.e., densities of the form $π\propto e^{-f-g}$, assuming access to gradient evaluations of $α_f$-convex $f$ and a restricted Gaussian oracle (RGO) for $α_g$-convex $g$, where $α_g \ge 0$. The latter requirement means that we can easily sample from the density $\text{RGO}_{g,h,y}(x) \propto \exp(-g(x) -\frac{1}{2h}||y-x||^2)$, which is the sampling analogue of the proximal operator for $g$. If $f + g$ is $α$-convex and $f$ is $β$-smooth, our sampler achieves $\varepsilon$ error in total variation distance using $\widetilde{\mathcal O}(κ\sqrt d \log^4(1/\varepsilon))$ oracle calls where $κ:= 1 \vee β/α$, with $0\le α_g \le β$ and $α:= α_f + α_g > 0$, which matches prior state-of-the-art results for the case $g=0$. We further extend our results to cases where (1) $π$ is non-log-concave but satisfies a Poincaré or log-Sobolev inequality, and (2) $f$ is non-smooth but Lipschitz.

math.ST↗

arXiv2026

Optimal score function estimation via derivatives constraints

We provide a statistical theory explaining why empirical score matching can achieve minimax optimal performance for diffusion generative models when the data distribution is supported on a low-dimensional manifold. More precisely, we establish convergence rates for empirical risk minimization over suitably constrained Sobolev classes and show that, under appropriate regularity conditions, the resulting score estimators lead to minimax optimal Wasserstein-1 rates for the generated distribution, up to logarithmic factors. Our results provide sufficient conditions for score-based generative modeling to generalize from the data instead of overfitting, while the resulting statistical rates depend on the intrinsic dimension of the data manifold rather than its ambient dimension.

math.ST↗

arXiv2026

Ultra-high-dimensional spot support screening in continuous-time regression

We study variable screening for high-frequency continuous-time regression, targeting the support of the spot regression coefficient. We establish uniform entrywise bounds for local estimates of the marginal correlation vector and covariate correlation matrix under coordinatewise truncation and finite-variation jumps. Under a local averaged $α$-Hölder condition, the rate is $\{(\log p)/n\}^{α/(2α+1)}$, up to logarithmic factors. This yields sure screening for the marginal support. We also derive a list-size minimax lower bound that matches the localization and multiplicity order when the retained list size $d$ satisfies $\log(p/d)\asymp\log p$. For regression-support recovery under local dependence, we propose partial-residual spot iterative screening with pathwise Lepski adaptation. Under sparse eigenvalues and standardized beta-min, the procedure has the sure screening property and requires only correlation columns associated with the current active set. Simulation studies and a high-frequency factor application illustrate its performance.

math.ST↗