RedKnot establishes a new foundation for AI infrastructure by transforming the KV cache from a monolithic, passive runtime artifact into a dynamic, model-aware runtime substrate for scalable LLM serving.
Yang Liu, Zhao-Kai Luo, Hua-Yi Jin et al.· arXiv.org· 7 citations· ⚡1
This work presents a DeepSeek-V4 realization of RedKnot's head-aware reuse principle, a DeepSeek-V4 realization of RedKnot's head-aware reuse principle, and describes the factorization, position repair, token-row closure, sparse-MoE support, TP8 integration, and the measurement boundaries needed to interpret these resu...
Yang Liu, Zhao-Kai Luo, Hua-Yi Jin et al.· 0 citations
This work proposes Akashic, a low-overhead memory system built around MemAttention, which organizes context into bounded chunks and models semantic relationships across chunks, preserving cross-chunk evidence without repeatedly rewriting the full history.
Yang Liu, ZhaoKai Luo, Huayi Jin et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.