"As a Language Model...": Chat Template Switches LLM Self-Referential Voice and Activation Steering Reproduces It
It is shown that the chat template works like a switch - when present, it turns this disclaimer voice up and experiential voice like"I feel"down, across 8 popular open-source instruct models up to 9B parameters in size, and there is a direction they can use to steer this voice.