arXiv · 2611.18814
Causal Regularization for Robust Prediction
Abstract
Prediction is an important use of a statistical model. However, predictive systems typically struggle when the environment, in which they were trained, changes. Robust prediction that can deal with distributional shifts has become an active research area. Existing approaches tend to make strong assumptions in order to achieve prediction guarantees. In this paper, we only require finite second moments in the training data to obtain sharp prediction guarantees. We generalize causal regularization to a framework that uses two environments and measures the differences between them through a generalized risk difference induced by changes in second-order moments of the covariates and response. By defining a sieve of out-of-sample distributions, we derive a worst-risk decomposition over increasing classes of environments and obtain a closed-form estimator that interpolates between OLS and the regularization limit solution. Causal interpretation is recovered under the inner-product invariance condition and when the conditional mean of the target given its causal parents remains invariant across environments. Our results show that the proposed estimator can achieve prediction stability over a broad class of perturbed environments, even when trained on a limited set. The framework separates two goals: robustness as a stable prediction under weak assumptions and causality as a stronger property obtained with additional invariance structure.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Alessia Berarducci, Melania Lembo, Veronica Vinciotti, Ernst C. Wit. 2026-11-13. Causal Regularization for Robust Prediction. https://arxiv.science/abs/2611.18814
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.