ValueDiff: Value-Geometric KV Cache Eviction for Sink-Suppressed LLMs
ValueDiff, a value-geometric eviction that ranks tokens by the L2 deviation of their value vectors from the cache mean, is presented, and value geometry emerges as the more reliable query-invariant eviction signal for sink-suppressed models.
Junyoung Park, Jungwook Choi, Min-Gu Lee
· 0 citations