How LLMs Are Persuaded: A Few Attention Heads, Rerouted
This work studies causal interventions in controlled multiple-choice tasks and identifies that persuasion mainly acts through a small set of mid-layer attention heads, which are decision heads, which mainly acts through a one-dimensional option-routing feature in the option-token representations.