arXiv Science⌕ Search

arXiv · 2611.13882

Backtesting High-Dimensional Expected Shortfall

Abstract

Forecast evaluation increasingly uses high-dimensional predictors, but estimation and regularization of large predictive models can distort conventional backtests. This issue is particularly important for forecasting downside risk, where the signal-to-noise ratio is low. We develop out-of-sample Expected Shortfall (ES) backtests that remove the large first-order bias effects of estimating high-dimensional Value-at-Risk, ES, and the evaluation instrument. In a linear ES specification, the proposed methods are easily implemented as Double Lasso with a tail-size-adjusted score as a generated dependent variable. More generally, we characterize orthogonal ES backtesting moments, and establish oracle equivalence and valid inference under time-series dependence and repeated estimation with overlapping and expanding training windows. Simulations show that conventional backtests can severely overreject ES optimal forecasts, whereas orthogonalization improves size control. An application to downside-growth forecasting for G7 economies finds evidence against a US growth-only ES specification, even though forecast-oriented regularization selects no additional financial predictors. The application also shows that accounting for estimation can change rejection decisions in either direction. These findings highlight the distinct roles of predictive variable selection and backtesting in the evaluation of high-dimensional tail-risk models.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Zaichao Du, Juan Carlos Escanciano, Pei Pei. 2026-11-10. Backtesting High-Dimensional Expected Shortfall. https://arxiv.science/abs/2611.13882

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

Difference-in-Differences Estimators for Treatments Continuously Distributed at Every Period

When studying the effects of taxes, tariffs, or prices using panel data, the treatment is often continuously distributed in every period. We develop difference-in-differences (DID) estimators for such settings. We partition units into switchers, whose treatment changes between consecutive periods, and stayers, whose treatment remains constant. Under a parallel-trends assumption, we show that the slopes of switchers' potential outcomes with respect to the treatment are nonparametrically identified by DID comparisons between switchers and stayers sharing the same baseline treatment level. Conditioning on the baseline treatment is key, as it ensures that the underlying parallel-trends assumption accommodates time-varying treatment effects. We then study two weighted averages of these slopes, discuss their respective advantages, and propose for each a doubly robust, semiparametrically efficient, and $\sqrt{n}$-consistent estimator. Finally, we extend our framework to instrumental variables and illustrate it by estimating the effects of gasoline taxes on prices and fuel consumption.

econ.EM↗

Difference-in-differences for mediation analysis using double machine learning

We propose a difference-in-differences (DiD) framework with mediation for possibly multivalued discrete or continuous treatments and mediators, aimed at identifying the direct effect of the treatment on the outcome (net of effects operating through the mediator), the indirect effect via the mediator, and the joint effects of treatment and mediator, consistent with the framework of dynamic treatment effects. Identification relies on a conditional parallel trends assumption imposed on the mean potential outcome across treatment and mediator states, or (depending on the causal parameter) additionally on the mean potential outcomes and potential mediator distributions across treatment states. We propose ATET estimators for repeated cross sections and panel data within the double/debiased machine learning framework, which allows for data-driven control of covariates, and we establish their asymptotic normality under standard regularity conditions. We investigate the finite-sample performance of the proposed methods in a simulation study and illustrate our approach in an empirical application to the US National Longitudinal Survey of Youth, estimating the direct effect of health care coverage on general health as well as the indirect effect operating through routine checkups.

econ.EM↗

The Online LSTM Prediction Models and The Term Structure of Predictions

We examine and illustrate the properties of the Long Short Term Memory (LSTM) prediction models applied online to stationary inputs. We discuss the effects of: a) the network architecture that defines the admissible prediction functions, b) the objective function used to measure the prediction accuracy, and c) the Stochastic Gradient Descent (SGD) algorithm. We also study the prediction optimality, the term structure of predictions, the filtered memory dynamics. We also introduce a set of diagnostic tools for memory-based prediction models that focus on the estimated dynamics of the hidden states.

econ.EM↗