Zhichen Liu

LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference

An intrinsic memory method, LiveMem, is introduced, which augments a pretrained full-attention LLM with a memory state that preserves the historical information over the whole lifecycle while the main attention path retains a bounded KV window and establishes state continuity as a distinct and complementary abstraction...