Budgeted KV-Cache Repair for Evolving Contexts
Language-model agents revise their working context as information becomes obsolete, but deleting text does not erase its influence on cached computation. Later key-value (KV) states remain conditioned on the deleted content, while recomputing the entire retained suffix can be costly. We introduce budgeted KV-cache repa...
Han Yu, Wen-Hui Zhu, Jincheng Cao et al.
· 0 citations