Sebastian A. Bruijns

Pretraining Curricula Enable Selective Fine-tuning

It is shown that imbalanced learning of two conflicting copy tasks promotes in-context learning and improves the selectivity of refusal fine-tuning, suggesting that imbalanced pretraining curricula may be an important tool for promoting disentangled representations, with direct consequences for the precision and reliability of safety fine-tuning.