Aug 2026
Mitigating Reasoning-Induced Misalignment via Safety-Direction Penalty
A representation-space analysis of RIM and the Safety-Direction Penalty (SDP), which penalizes movement along a learned safety direction during reasoning fine-tuning, is provided, which restores safety while preserving benchmark reasoning performance.
Yipeng Zhao, Qi-Shun Yang, Shenzhe Zhu et al.
· arXiv.org · 0 citations