Revisiting Over-refusal in Safety-aligned Large Language Models: A Representation and Optimization Perspective
Over-refusal is a critical side effect of safety alignment in large language models (LLMs), causing harmless but superficially risky queries to be mistakenly rejected. Despite the effectiveness of existing mitigation methods, why safety-aligned LLMs may still reject harmless queries under correct safety supervision rem...
Chao Chen, Pengyang Shao, Wei Qin et al.
· 0 citations