Review
Oct 2026
UlaCache: Unified Logical Addressing for Sparse LLM Serving
UlaCache is presented, a KV cache management system that provides unified logical addressing across GPU and CPU memory that reduces the overhead of KV replacement by parallelizing recency updates and eviction-candidate selection within a GPU memory pool shared across requests.
Isaac Zhu, Alan Cao, Hugh Yin et al.
· 0 citations