arXiv Science⌕ Search

arXiv subjects

Ryo Emoto

Publications and source records attributed to Ryo Emoto.

2 recordsLinked to original sources

Estimand-specific bootstrap confidence intervals after optimism correction for prediction models

Confidence intervals after bootstrap optimism correction are often reported for prediction models, but what they cover depends on the estimand. We distinguish two estimands: the target-population performance of the final model developed from the observed sample, $θ_{\mathrm{FM},n}$, and the average performance over repeated model development, $θ_{\mathrm{proc},n}$. Using first-order expansions of the estimation errors, we identify the bootstrap root that matches the error for $θ_{\mathrm{FM},n}$. We use this root in the nested error bootstrap (NEB) as a new reference method, and we show that the optimism error bootstrap (OEB), which needs no inner bootstrap, approximates NEB. We also show that the conventional two-stage bootstrap (TSB) and location-shifted bootstrap (LSB) reproduce the first-order variation for $θ_{\mathrm{proc},n}$. In simulations, NEB generally achieved coverage closer to the nominal level than TSB and LSB for the area under the receiver operating characteristic curve, Brier score, and log loss. OEB was close to NEB at moderate to high events per variable (EPV) but could give narrower intervals at low EPV. The distinction is particularly clear for calibration measures: first-order effects of perturbing the training and evaluation distributions cancel in the TSB root, yielding a degenerate first-order limit. In contrast, the NEB root has a nondegenerate first-order limit and yields asymptotically valid confidence intervals for $θ_{\mathrm{FM},n}$ under regularity conditions. Consistent with theory, TSB showed substantial undercoverage for calibration even at larger sample sizes. Our findings emphasize the need to construct confidence intervals for a specified estimand and performance measure.

stat.ME↗

Debiased and Simultaneous Inference for Heterogeneous Factorial Effect Modifiers via Residualized Walsh-Hadamard Scores

In factorial randomized experiments with $K$ binary treatment components, we study which baseline covariates modify component main effects and interactions. We define effect-modifier cells $(j,S)$, $j\in[p]$ and $\emptyset\neq S\subseteq[K]$, through the coefficients $θ^\ast_{jS}$ of population linear projections of conditional Walsh--Hadamard contrasts $τ_{S}$ onto standardized covariates. Using baseline-robust direct scores, we develop frequentist inference for all $p(2^K-1)$ cells. First, we prove a debiased central limit theorem with global insensitivity: the residualization baseline enters the cross-fitted score through an exactly conditionally mean-zero perturbation. The influence-function remainder therefore requires only foldwise weighted $L_2$ consistency of the baseline estimator, with no prescribed polynomial rate or nuisance product-rate condition. A separate, explicit penalty-scale condition controls the baseline's effect on the score Lasso. Second, under explicitly stated uniform nuisance, baseline, studentization, and influence-array conditions derived from bounded sparse-regression primitives, we establish a high-dimensional Gaussian approximation over the full grid, calibrated by a Walsh-spectral multiplier bootstrap. This yields simultaneous confidence bands and Romano--Wolf step-down selection of modified cells with strong familywise error control, without effect-heredity assumptions. The factorial design is fixed in the asymptotic analysis, while the covariate dimension may grow; all $2^K-1$ contrasts are covered jointly.

stat.ME↗