RedKnot-MLA: Multi-Head Offline-Online Reuse for DeepSeek-V4 Long-Context Serving
This work presents a DeepSeek-V4 realization of RedKnot's head-aware reuse principle, a DeepSeek-V4 realization of RedKnot's head-aware reuse principle, and describes the factorization, position repair, token-row closure, sparse-MoE support, TP8 integration, and the measurement boundaries needed to interpret these resu...
Yang Liu, Zhao-Kai Luo, Hua-Yi Jin et al.
· 0 citations