TY - RPRT TI - What Makes a Reward Model a Good Teacher? An Optimization Perspective AU - Noam Razin AU - Zixuan Wang AU - Hubert Strauss AU - Stanley Wei AU - Jason D. Lee AU - Sanjeev Arora PY - 2026 UR - https://arxiv.org/abs/2503.15477 ID - 2503.15477 ER -