Latent Compaction with Test-Time Training
Results show that treating the KV cache as a neural network and optimizing it with test-time training can preserve retrieval accuracy under aggressive compression, and transfers across model scales and families.
Yingfa Chen, Xing-Yu Shen, Chao-Jun Xiao et al.
· 1 citation
· ⚡1