Gui-Jia Zhang

Aborted but Not Forgotten: KV-Cache Retention Breaks Rollback Consistency in Language Agents

Stateful language agents assume a rejected branch can be taken back by clearing it from the application transcript. We show this breaks when the serving session retains key/value (KV) state across the logical abort: the model can continue attending to content the application believes it discarded. We formalize the miss...