Mitigating Reasoning-Induced Misalignment via Safety-Direction Penalty
A representation-space analysis of RIM and the Safety-Direction Penalty (SDP), which penalizes movement along a learned safety direction during reasoning fine-tuning, is provided, which restores safety while preserving benchmark reasoning performance.