arXiv · 2611.13451
Economics of Selection in Ranking & Selection: Neither Fixed-Precision nor Fixed-Budget
Abstract
Ranking and selection (R&S) has evolved tremendously over the last several decades, with applications in agriculture, discrete optimization with computer simulation, clinical trial design, and other areas. We challenge a widely accepted classification of R&S procedures into two categories: fixed-precision and fixed-budget. We discuss a third class, economics-of-selection (EoS) procedures, which is conceptually distinct and is found in the extant literature on Bayesian hypothesis testing and simulation optimization. Procedures in this third class seek to optimally balance two quantities: the cost of learning about the performance of each alternative and the quality of the alternative ultimately selected on the basis of that learning. Fixed-precision and fixed-budget procedures tend to optimize one of these quantities while constraining the other. We clarify these differences and show why they matter. We then present new frequentist R&S procedures in this third category, including both two-stage procedures and a sequential heuristic, assuming Gaussian observations with either known or unknown variances. We find that EoS is not a question of Bayesian versus frequentist analysis, asymptotic versus finite-sample analysis, finite-stage versus fully sequential procedures, or comparing one mean with a standard versus comparing multiple alternatives. We identify opportunities for further R&S research.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Stephen E. Chick, Zaile Li, L. Jeff Hong. 2026-11-10. Economics of Selection in Ranking & Selection: Neither Fixed-Precision nor Fixed-Budget. https://arxiv.science/abs/2611.13451
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.