You Are What You Read: Misalignment via In-Context Persona Induction
Broad misalignment has been produced by finetuning on narrow data, harmful or benign, and in context only by demonstrations of the undesirable behaviour itself by demonstrations of the undesirable behaviour itself.
Kyuhee Kim, Benjamin Berczi, C. Ududec
· 0 citations