Adityanarayanan Radhakrishnan

Efficient and accurate steering of large language models through attention-guided feature learning

Activation steering, or direct manipulation of internal activations to guide large language model (LLM) responses toward specific semantic concepts, is emerging as a promising avenue for both understanding how semantic concepts are stored within LLMs and advancing LLM capabilities. Yet, existing steering methods are re...