GAPS: Dimension-Level Gates for Conditional Activation Steering
Activation steering suppresses undesired behaviors in language models by adding a steering vector to the hidden state during generation. Recent conditional methods such as CAST and DSAS improve the behavior-capability trade-off by deciding when to intervene, but once active, they apply the full dense vector to all hidd...
Moghis Fereidouni, Muhammad Umair Haider, Hassan Sajjad et al.
· 0 citations