Robust and efficient multiple-unit switchback experimentation

Paul Missault; Lorenzo Masoero; Christian Delbé; Thomas Richardson; Guido Imbens

Home/Archive/arXiv

arXiv · 2506.12654

Robust and efficient multiple-unit switchback experimentation

Paul Missault·Lorenzo Masoero·Christian Delbé·Thomas Richardson·Guido Imbens

View original source ↗Read source document ↗Export metadata ↓

Abstract

User-randomized A/B testing has emerged as the gold standard for online experimentation. However, when this kind of approach is not feasible due to legal, ethical or practical considerations, experimenters have to consider alternatives like item-randomization. Item-randomization is often met with skepticism due to its poor empirical performance. To fill this gap, in this paper we introduce a novel and rich class of experimental designs, "Regular Balanced Switchback Designs" (RBSDs). At their core, RBSDs work by randomly changing treatment assignments over both time and items. After establishing the properties of our designs in a potential outcomes framework, characterizing assumptions and conditions under which corresponding estimators are resilient to the presence of carryover effects, we show empirically via both realistic simulations and real e-commerce data that RBSDs systematically outperform standard item-randomized and non-balanced switchback approaches by yielding much more accurate estimates of the causal effects of interest without incurring any additional bias.

Explore related subjects

stat.ME stat.AP

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Paul Missault, Lorenzo Masoero, Christian Delbé, Thomas Richardson, Guido Imbens. 2025-06-14. Robust and efficient multiple-unit switchback experimentation. https://arxiv.org/abs/2506.12654

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

A robust, scalable K-statistic for quantifying immune cell clustering in spatial proteomics data

Spatial summary statistics based on point process theory are widely used to quantify the spatial organization of cell populations in single-cell spatial proteomics data. Among these, Ripley's K is a popular metric for assessing whether cells are spatially clustered or are randomly dispersed. However, the key assumption of spatial homogeneity is frequently violated in spatial proteomics data, leading to overestimates of cell clustering and colocalization. To address this, we propose a novel method, termed KAMP (K adjustment by Analytical Moments of the Permutation distribution), for quantifying the spatial organization of cells in spatial proteomics samples. KAMP leverages background cells in each sample along with a new closed-form representation of the first and second moments of the permutation null distribution of Ripley's K. Our method is robust to inhomogeneity, computationally efficient even in large datasets, and provides approximate p-values to test spatial clustering and colocalization. Methodological developments are motivated by a spatial proteomics study of women with ovarian cancer; in the subset with sufficient B cells and macrophages, KAMP provides exploratory, scale-specific evidence linking B cell-macrophage colocalization with overall patient survival. Notably, we also find evidence that using K without correcting for sample inhomogeneity may bias hazard ratio estimates in downstream analyses.

stat.ME↗

arXiv2026

A Heavily Right Strategy for Statistical Inference with Dependent Studies in Arbitrary Dimensions

We leverage recent advances in heavy-tail approximations for global hypothesis testing with dependent studies to construct approximate confidence regions without modeling or estimating their dependence structures. A non-rejection region is a confidence region but it may not be convex. Convexity is appealing because it ensures any one-dimensional linear projection of the region is a confidence interval, easy to compute and interpret. We show why convexity fails for nearly all heavy-tail combination tests proposed in recent years, including the influential Cauchy combination test. These insights motivate a heavily right strategy: truncating the left half of the Cauchy distribution to obtain the Half-Cauchy combination test. The harmonic mean test also corresponds to a heavily right distribution with a Cauchy-like tail, namely a Pareto distribution with unit power. We prove that both approaches guarantee convexity when individual studies are summarized by Hotelling $T^2$ or $χ^{2}$ statistics (regardless of the validity of this summary) and provide efficient, exact algorithms for implementation. Applying these methods, we develop a divide-and-combine strategy for mean estimation in any dimension and construct simultaneous confidence intervals in a network meta-analysis for treatment effect comparisons across multiple clinical trials. We also present many open problems and conclude with epistemic reflections.

stat.ME↗

arXiv2026

Recent advances in the Bradley--Terry Model: theory, algorithms, and applications

This article surveys recent advances in the Bradley-Terry (BT) model and its extensions. We focus on statistical and computational aspects, with particular emphasis on the regime in which both the number of objects and the volume of comparisons tend to infinity-a setting relevant to large-scale applications. The main topics include asymptotic theory for statistical estimation and inference, together with the corresponding computational algorithms. We also review applications of these models in sports analytics, social choice, psychometrics, and machine learning. Finally, we discuss several key challenges and outline directions for future research.

stat.ME↗