arXiv · 2611.18965
Contextual Non-Convex Bandit Optimization with Two-Point Feedback
Abstract
We study a non-stochastic contextual bandit problem with Lipschitz losses. At every round, the learner observes the context then picks two actions, observes the difference between their losses, and incurs their mean. The aim is to minimize the regret against a generic non-parametric comparator class of policies mapping contexts to actions; for example, Lipschitz policies and Hölder-smooth policies. We show how relying on a hierarchical discretization technique allows us to improve upon the regret rates achievable under one-point feedback, and even recover the full-information rate in some cases; notably, for sufficiently smooth policy classes or low-dimensional instances. Additionally, for Lipschitz policies, we present an algorithm whose per-round computational complexity is only logarithmic in the time horizon.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Khaled Eldowa, Pierre Gaillard. 2026-11-13. Contextual Non-Convex Bandit Optimization with Two-Point Feedback. https://arxiv.science/abs/2611.18965
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.