arXiv · 2611.17082
Isotonic least squares is robust to heteroscedasticity, unimodal least squares is not
Abstract
We compare the least squares estimator (LSE) with the $\ell_{1}$-estimator recently introduced by Baraud and Maillard~\citeyearpar{BM-2026} for estimating a regression function under a fixed design, when the errors are independent but possibly heteroscedastic and heavy-tailed. We show that the two estimators coincide on the class of nondecreasing (or nonincreasing) functions on an interval. As a consequence, the isotonic LSE inherits the non-asymptotic $\ell_{1}$-risk bounds of the $\ell_{1}$-estimator, which only require a moment of order $p\in[1,2]$ on the errors and depend on the average of their $p$-th absolute moments rather than on their maximum. This coincidence no longer holds on the nonconvex class of unimodal functions: we exhibit a heteroscedastic Gaussian example in which the LSE is inconsistent while the $\ell_{1}$-estimator converges at the parametric rate. Finally, we show on a one-dimensional linear model that neither estimator dominates the other: depending on the way the noise is distributed among the design points, the LSE may converge at rate $1/n$ while the $\ell_{1}$-estimator is inconsistent.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Yannick Baraud. 2026-11-12. Isotonic least squares is robust to heteroscedasticity, unimodal least squares is not. https://arxiv.science/abs/2611.17082
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.