TY - RPRT TI - When Scores Conflict with Preferences: Pre-Alignment Diagnosis and Adaptive Correction of Constraint Drift in DPO AU - Ping Liu AU - Yan Yan PY - 2026 UR - https://arxiv.org/abs/2611.07375 ID - 2611.07375 ER -