Hongli Shen

Dual-Adversarial Safety Alignment: Cultivating Intrinsic Threat Comprehension in LRMs

Experiments show that with only 1K synthesized samples, AdvSafe-aligned LRMs achieve significantly stronger jailbreak robustness than existing baselines, with almost no utility degradation, demonstrating that learning unsafety knowledge enables a superior robustness-utility trade-off and generalizes beyond seen attack patterns.