arXiv Science⌕ Search

arXiv · 2610.36283

Minimax Rates for Robust Gaussian Mean Estimation Near the Breakdown Point under Constraints

Abstract

We study the mean estimation of Gaussian location model with star-shaped constraints under adversarial contamination, where at most $ k<N/2 $ among $ N $ observations are corrupted by an oracle adversary. We characterize the minimax squared $ \ell_2 $ risk throughout the full range of contamination level $ \varepsilon = k/N \in [0,1/2) $. The minimax risk is \begin{equation*} \mathfrak{M}\asymp \big( δ_\varepsilon ^{*2} \vee σ^2\varepsilon ^2\log \frac{e}{1-2\varepsilon } \big) \wedge d^2 , \end{equation*} where $ δ_\varepsilon ^* := \sup \big\{ r \geq 0: (1-2\varepsilon )\frac{Nr ^2}{σ^2} \leq \log M^\mathrm{ loc }_K(r ,c) \big\} $, $ \log M^\mathrm{ loc }_K(r ,c) $ is the local entropy of constraint set $ K $, $ d $ is the diameter of $ K $ (set $ d=\infty $ if $ K $ is unbounded), $ σ^2 I_n $ is the covariance of the Gaussian noise, and $ c $ is a sufficiently large constant. Our result sheds light on the interaction between contamination error and information theoretic complexity in the regime of proximity to the breakdown point $ \varepsilon \uparrow 1/2 $.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Tuorui Peng, Matey Neykov. 2026-10-26. Minimax Rates for Robust Gaussian Mean Estimation Near the Breakdown Point under Constraints. https://arxiv.org/abs/2610.36283

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Wasserstein approximation of measures via orthogonal frames: statistical and computational complexities

Dimension-reduction methods such as PCA identify a subspace capturing most of the variation in the data, but not a distinguished basis within it. Selecting a basis in which the samples are sparsely represented is a recurring task in unsupervised learning, addressed by methods in factor analysis, dictionary learning, and subspace clustering. We pose this task as Wasserstein approximation of the data distribution by measures supported on the axes of an orthogonal frame, which, in turn, reduces to a nonsmooth optimization problem over the orthogonal group $\mathrm{O}(d)$. We show that, under mild assumptions, both empirical risk minimizers and a locally initialized stochastic gradient method recover the population-optimal frame at the near-parametric rate $\widetilde{O}_d(n^{-1/2})$, where $n$ is the sample size. The main difficulty is that, although the population objective is smooth, the empirical objective is not-this mismatch precludes standard covering arguments. We overcome this issue by replacing Lipschitz continuity of the empirical gradient with a coarsely Lipschitz bound, a tool that may be of independent interest. Numerical experiments support our theoretical findings.

math.ST↗

Compatibility-based Bayesian inference: asymptotic limits, variational principles, and Wasserstein geometry

Approximate Bayesian Computation (ABC) replaces intractable likelihood evaluations with comparisons between observed and simulated data. We formulate discrepancy-based inference through nonnegative compatibility weights. Prior-integrated convergence of rescaled weights gives total variation convergence as the tolerance vanishes. For a fixed positive tolerance and increasing sample size, we give a general representation-based formulation of the conditional-prior limit known from ABC and coarsened Bayesian inference, and establish convergence in expected total variation under stabilization in probability and a prior-null boundary condition. We also derive acceptance-persistence bounds under partial stabilization. The Gibbs variational identity yields convergence of minimum values and stability of approximate minimizers; the fixed-tolerance limit is characterized separately by constrained relative-entropy minimization. For additional penalty-based functionals of the limiting Wasserstein discrepancy, we prove an exact reduction to distributions over model laws and, under a geodesic assumption, a representation by distances from a Wasserstein ball. These penalty-based updates are distinguished from the original fixed-tolerance ABC limit and illustrated through a Gaussian comparison.

math.ST↗

A theory of stratification learning

Given i.i.d. sample from a stratified mixture of immersed manifolds of different dimensions, we study the minimax estimation of the underlying stratified structure. We provide a constructive algorithm allowing to estimate each mixture component at its optimal dimension-specific rate adaptively. The method is based on an ascending hierarchical co-detection of points belonging to different layers, which also identifies the number of layers and their dimensions, assigns each data point to a layer accurately, and estimates tangent spaces optimally. These results hold regardless of any ambient assumption on the manifolds or on their intersection configurations. They open the way to a broad clustering framework, where each mixture component models a cluster emanating from a specific nonlinear correlation phenomenon.

math.ST↗