From Frequentist to Bayesian Contextual Optimization

Abstract

In data-driven contextual stochastic optimization, existing approaches are predominantly frequentist: they commit to a single predictive model and treat it as ground truth, yielding prescriptions that are fragile to model uncertainty and sampling variability in small- and moderate-sample regimes. We propose Bayesian contextual optimization (BCO), a framework that maintains a Gibbs posterior over the parameter space. This decision-focused posterior weights candidate models by their empirical decision quality rather than statistical fit, thereby avoiding commitment to a potentially misspecified likelihood while encoding the full distribution of plausible models consistent with the data. A Bayesian contextual policy is then derived by minimizing the expected decision cost under the posterior predictive distribution, hedging prescriptions against model uncertainty by aggregating over the posterior. We establish three theoretical guarantees: (i) the Gibbs posterior concentrates exponentially fast around the frequentist best-in-class parameter set; (ii) BCO can strictly improve over the frequentist best-in-class policy when model uncertainty is non-negligible; and (iii) BCO attains an $O(n^{-1/2})$ excess risk rate against the oracle over all probability measures up to a misspecification term and an oracle aggregate gap. Computationally, we tailor a variational inference scheme that has the same per-iteration cost as frequentist alternatives and a gradient-free Metropolis-Hastings algorithm that handles nondifferentiable problems. Numerical experiments on two-stage shipment planning, contextual newsvendor, and return-constrained portfolio problems confirm that BCO consistently reduces out-of-sample cost and variance relative to kernel estimators and decision-focused baselines, with the most pronounced gains in small- and moderate-sample regimes under substantial model uncertainty.