Tracing mechanisms of sycophantic agreement in language models
Sycophantic agreement in language models refers to the tendency to overly affirm a user's stated beliefs or preferences, often at the expense of factual accuracy. Although it is widely recognized as an alignment failure, its underlying mechanisms remain poorly understood. In this work, we use causal mediation analysis...
Si-Xing Chen, Zhuo-Fan Ying, L. Smith et al.
· 0 citations