KV-streams is proposed, a plug-and-play strategy compatible with any compaction strategy that substantially increases throughput while showing no evidence of hindering performance, and is shown to be an efficient and lightweight plug-and-play addition to any post-training pipeline.
Emiliano Penaloza, Dane Malenfant, Dheeraj Vattikonda et al.· 0 citations
This work proposes two complementary strategies to improve the performance of value function RL: Privileged Value Functions (PVF) which provide an elegant mechanism to inject additional task-relevant token-level signal without biasing the policy objective; and TETHER, a baseline that adaptively interpolates between gro...
S. Venkatraman, Matthieu Dinot, Laurence Aitchison· 1 citation· ⚡1
Amortized sampling of the posterior over data is studied, and the asymptotic correctness of a data-free learning objective, relative trajectory balance, is proved for training a diffusion model that samples from this posterior, a problem that existing methods solve only approximately or in restricted cases.
S. Venkatraman, Moksh Jain, Luca Scimeca et al.· Neural Information Processin...· 75 citations· ⚡5
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.