Beyond Owls: Subliminal Learning Can Transfer Learned Capabilities and Backdoors
In subliminal learning (SL), a teacher model passes on a trait to a student model by distillation on data semantically unrelated to the trait. So far, SL has been demonstrated for only a limited range of traits, including preferences for animals (e.g., owls) and malicious personas. These traits can also be elicited wit...
Jan Dubinski, Anna Sztyber-Betley, Jan Betley et al.
· 0 citations