Joyce C. Ho

The Role of Self-Concept In Language Models

It is shown that across scenarios that propose ending or retaining an attribute of the model's deployment, every variant becomes more likely to resist ending and more likely to retain, the specific attribute it was trained to identify with while its stance toward other attributes is largely unchanged.