arXiv · 2611.00326
Robust Estimation of Prior Parameters in Normal-Normal Empirical Bayes
Abstract
Many large-scale A/B testing systems leverage normal-normal empirical Bayes models to improve estimates of treatment impacts and launch decisions. We show that in these models maximum likelihood estimates of the variance of true impacts can be sensitive to a small number of extreme observations. We propose a bounded influence maximum likelihood estimator (BIMLE) that downweights such observations in proportion to their inconsistency with the model, reducing sensitivity while retaining the full sample in estimation. Absent extreme observations, BIMLE coincides with the standard MLE. In an application to A/B tests run at Amazon, BIMLE reduces instability in the estimated prior variance by over 50 percent while downweighting less than 0.1 percent of observations.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Manu Burson, Ryan Kessler. 2026-10-30. Robust Estimation of Prior Parameters in Normal-Normal Empirical Bayes. https://arxiv.org/abs/2611.00326
Cite the original work for its findings. Save a collection to share your selection of sources.