arXiv · 2611.11582
Robust Gaussian process regression: posterior contraction
Abstract
Gaussian processes form a popular and flexible class of prior distributions with principled uncertainty quantification, but the Gaussian likelihood on which the corresponding posterior relies makes them highly sensitive to outliers and contaminated observations. We study Gaussian process regression when among the $n$ observations, $m$ of these are possibly contaminated. A generic framework to obtain posterior contraction rates in this setting is considered, from a frequentist perspective as the sample size $n$ and the number of corrupted observations $m$ grow. We adopt a generalized Bayes approach in which the log--likelihood is replaced by a robustified version; we discuss various choices thereof, such as one recently proposed by Altamirano et al. that preserves conjugacy. We investigate the minimax rate of estimation under adversarial contamination in terms of the Sobolev smoothness $β$ of the regression function and $m$. The question of building adaptive procedures to both $β$ and $m$ is investigated, and we show that a polynomial loss for adaptation must be paid in general. We instantiate our results for Matérn Gaussian process and deep ReLU network priors. Numerical experiments for existing and new robust algorithms are provided, illustrating the practical applicability of our results.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Ismaël Castillo, Paul Egels, Riccardo Lazzarini, Botond Szabó. 2026-11-08. Robust Gaussian process regression: posterior contraction. https://arxiv.science/abs/2611.11582
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.