TY - RPRT TI - Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall AU - Jacqueline He AU - Howard Yen AU - Shuyue Stella Li AU - Margaret Li AU - Hanqing Zeng AU - Yinglong Xia AU - Benyu Zhang AU - Zhuokai Zhao AU - Qiang Zhang AU - Pang Wei Koh AU - Luke Zettlemoyer AU - Wen-tau Yih PY - 2026 UR - https://arxiv.org/abs/2609.01532 ID - 2609.01532 ER -