Preprint
Aug 2026
LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference
An intrinsic memory method, LiveMem, is introduced, which augments a pretrained full-attention LLM with a memory state that preserves the historical information over the whole lifecycle while the main attention path retains a bounded KV window and establishes state continuity as a distinct and complementary abstraction...
Zhichen Liu, Ruihan Sun, Heng Yang et al.
· 1 citation
· ⚡1