It is found that efficient steering methods frequently achieve conditioning at a steep cost to fluency, and a critical yet previously overlooked interaction with the training paradigm is identified: activation steering methods are far less effective on instruction-tuned models than on their base counterparts.
Iuri Macocco, Pau Rodríguez, Arno Blaas et al.· arXiv.org· 2 citations· ⚡1
The s-Trace method is introduced to efficiently estimate a subgraph of size s that approximates a full model output, and the amount of necessary computation per input correlates with model uncertainty, and that sparser subgraphs encode shallow statistics, such as unigram frequency.
A scale-dependent transition between two ID regimes is found: at low lexical diversity, conditions with fewer unique final words produce higher ID, while at high lexical diversity, this ordering reverses, and conditions with more unique words produce higher ID.
Arwa Osman, Marco Baroni, Iuri Macocco· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.