Quality Recovery for Quantized KV Caches via Low-Rank Attention Adaptation
The results show that low-rank projection adaptation can recover held-out quality across fixed cache formats, while perplexity recovery need not restore long-context retrieval.
Seifeldin Abdellatif
· 0 citations