Dimension-free comparison inequalities between $f$-divergences for Gaussian location mixtures

Jeonghwan Lee; Cong Ma

Home/Archive/arXiv

arXiv · 2610.25070

Dimension-free comparison inequalities between $f$-divergences for Gaussian location mixtures

Jeonghwan Lee·Cong Ma

View original source ↗Read source document ↗Export metadata ↓

Abstract

We establish dimension-free comparison inequalities between the Kullback-Leibler (KL) and $χ^2$-divergences and the squared Hellinger distance for Gaussian location mixtures with compactly supported mixing distributions. We show that both divergences are bounded by the squared Hellinger distance up to constants depending only on the radius of the support, independently of the ambient dimension and the number of mixture components. These results resolve an open question raised by \cite{jia2023entropic} and strengthen existing comparison inequalities. Our proof relies on a Gaussian interpolation argument that relates the derivatives of these divergences to differences between posterior means.

Explore related subjects

math.ST cs.IT math.IT math.PR stat.ML stat.TH

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Jeonghwan Lee, Cong Ma. 2026-10-18. Dimension-free comparison inequalities between $f$-divergences for Gaussian location mixtures. https://arxiv.org/abs/2610.25070

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Axioms for validity: e-values, p-values and data-dependent levels

The emerging literature on hypothesis testing with data-dependent significance levels relies on a particular extension of the Type-I error. Existing arguments for this extension are heuristic. We show it is uniquely characterized by three axioms: law-invariance, agreement with classical testing on constant levels, and the preservation of (in)validity under independent selection of the level. We find that three analogous axioms characterize the e-value as a multi-decision generalization of a test in a decision-theoretic framework. We recover the p-value by dropping the invalidity half of the independent selection axiom, showing that e-values correspond to those p-values for which a data-independent choice between two invalid p-values cannot produce a valid p-value. Our main technical contribution is to show how e-values emerge in every decision problem with a notion of validity that satisfies law invariance, the independent selection axiom, and an axiom stating that a procedure that selects an invalid procedure with arbitrarily high probability must itself be invalid. In an application to post-hoc decision-making, we justify expectation-based error rates in multiple testing and recover the 'e-closure principle' as a special case.

math.ST↗

arXiv2026

Optimal Community Recovery by Spectrally Initialized Variational EM in General Stochastic Block Models

We prove a Chernoff-exponent guarantee for the output of spectrally initialized batch variational EM after a prescribed iteration budget, without assuming global maximization of its variational objective. The iteration repeatedly estimates the entire block probability matrix and community proportions from the same sparse graph. We consider a fixed number of communities with proportions bounded away from zero and fixed, positive, distinct connectivity profiles; neither assortativity nor full rank is required. The algorithm uses simultaneous softmax updates without sample splitting or posterior thresholding. Its analysis must control the feedback between estimated parameters, soft labels and reused edges at an exponentially small risk scale. We establish a uniform one-step bound over data-dependent soft assignments whose random remainder has exponentially small expectation. Combined with an exponentially reliable regularized spectral initializer, this yields an unconditional expected misclassification rate bounded by $\exp\{-(1-o(1))J_n\}$ throughout the sparse, diverging-degree regime, where $J_n$ is the minimum nodewise Chernoff information. Matching lower bounds establish first-order logarithmic minimax optimality on local parameter spaces allowing unknown connectivity and varying community counts. The algorithm also attains the sharp first-order exact-recovery threshold. Numerical experiments illustrate refinement gains and sensitivity to initialization and imbalance.

math.ST↗

arXiv2026

Optimal Priors for Betting Tests with Bounded Payoffs: An Exact Efficiency Characterization

Testing by betting is a powerful framework that recasts hypothesis testing as a betting game. A popular approach uses an $F$-weighted portfolio with a predefined prior $F$. For suitable priors, this approach has recently been shown to achieve the optimal expected rejection time as the error probability goes to zero at a fixed alternative. Yet, the prior $F$ changes how the portfolio test behaves near the null. This motivates the question: Which prior should we use in testing-by-betting algorithms? We study bounded scalar payoffs and introduce an efficiency measure that allows the error probability and alternative to vary jointly. Under mild assumptions, we prove that efficiency equals a logarithmic decay index of the prior near zero. This gives a necessary and sufficient condition for optimality: Beta priors have infinite efficiency, whereas suitable Robbins-type priors attain efficiency 1. As an application, we consider testing a specified mean of a bounded random variable and describe an implementation of the portfolio algorithm with almost-linear computational complexity.

math.ST↗