Counterfactual Online Conformal Prediction Under Adaptive Logging
Online conformal prediction can fail when predictions shape actions and actions determine which outcomes enter calibration. Standard adaptive methods may retain marginal coverage while systematically miscovering the counterfactual outcomes of rarely selected actions. This paper formalizes the failure through counterfactual coverage and introduces Propensity-Weighted Online Conformal Prediction, an inverse-propensity-weighted recursion that debiases calibration. A doubly robust variant further reduces nuisance bias to the product of outcome-model and propensity errors. Under positivity and known logging probabilities, both methods attain the minimax expected coverage rate for nondegenerate calibration. Experiments on synthetic decision tasks, Open Bandit data, and financial rebalancing demonstrate counterfactual coverage gains under selection-biased logging, with prediction-set widths close to those of the oracle in the reported sharpness study.