Language models can answer a question from a supplied document or from their parametric knowledge. When later asked where the answer came from, what determines their source report? We study this by intervening on the model's key-value (KV) cache after the answer is generated and before the source question is asked. On...
Kirill Afendulev, Alexey Dontsov, Alla Chepurova et al.· 0 citations
Mechanistic interpretability aims to decompose neural network computations into human-understandable features, yet progress is limited by the absence of ground-truth units to evaluate against. We address this with a Sparse Transformer (ST): a 5-layer language model trained on TinyStories whose wide, TopK-sparse MLP for...
A. Korznikov, Alexey Dontsov, Elena Tutubalina· 0 citations
Two cache-level interventions are introduced: Split-prefill keeps only the KV cache or only the recurrent state from a prefilled context, then generates an answer, and state-swap pairs the KV cache from one context with the recurrent state from another in a single forward pass.
Kirill Afendulev, Alexey Dontsov, Elena Tutubalina et al.· 2 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.