arXiv · 2611.16558
Delta-Iterations: A General-Purpose Linear Regression Solver for Huber's Penalty, $ε$-Insensitive Loss, and Other Moreau Envelope-Based Loss Functions
Abstract
A general-purpose linear regression solver for a class of smooth loss functions is presented. The method applies to loss functions of the Moreau envelope type, which are continuously differentiable and have Lipschitz-continuous first derivatives. This class includes piecewise-defined cost functions consisting of constant, linear and quadratic segments, such as Huber's loss, insensitive least squares, one-sided least squares. The convergence guarantee provided by the associated proximal operator, the simplicity of the method and its versatility in handling various cost functions within a unified framework are its main advantages. MATLAB code for reproducing the numerical results presented in this article is provided.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Cagatay Candan. 2026-11-12. Delta-Iterations: A General-Purpose Linear Regression Solver for Huber's Penalty, $ε$-Insensitive Loss, and Other Moreau Envelope-Based Loss Functions. https://arxiv.science/abs/2611.16558
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.