Dialectics of Alignment: Harnessing Unsafe Knowledge for Dynamic Safety Routing
SafeMoE, a Mixture-of-Experts (MoE) framework that isolates unsafe knowledge into domain-specific Low-Rank Adapters (LoRA experts) trained exclusively on harmful corpora, is introduced, proposing a dialectical approach to alignment, positing that unsafe data encodes rich, domain specific knowledge critical for nuanced,...