Periodic Weak Spots: Phase Sensitivity from Chunked KV-Cache Compression
A systematic asymmetry in models using chunked KV-cache compression is uncovered: the same information can be easy to retrieve at one phase and difficult at another, revealing periodic weak spots that average benchmark scores can conceal.