arXiv · 2611.11959
On the Instance-Specific Sharp Rates for Constrained Least Squares Estimators in the Sequence Model
Abstract
We develop a general methodology based on the Feature Space Decomposition framework for establishing explicit, instance-specific sharp rates for the expected estimation error of convex-constrained least squares estimators in the sequence model, without requiring estimates of localized Gaussian mean widths. We apply this methodology to $\ell_q$ ellipsoids, $\ell_1$ balls, and $kB_1^N\cap B_\infty^N$, obtaining matching upper and lower bounds in the nondegenerate regime. Our methodology also extends beyond Gaussian noise to symmetric noise distributions satisfying a Poincaré inequality. We also provide an elementary proof of the instance-specific sharp rate for isotonic regression for any well-specified signal and any noise level. Combining this result with Han's asymptotic reduction, we further obtain explicit instance-specific sharp convergence rates in probability for isotonic regression in Gaussian linear regression under general signal-dependent asymptotics conditions.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Zong Shang. 2026-11-09. On the Instance-Specific Sharp Rates for Constrained Least Squares Estimators in the Sequence Model. https://arxiv.science/abs/2611.11959
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.