Preprint
Aug 2026
Who Should Own the Expert Cache? Kernel-Managed Tiering for Trillion-Parameter MoE Inference
The resulting design principle is simple: in this regime, let the kernel own eviction, while model-specific knowledge is best spent on admission and advice.
Yuan Si, Yufeng Lin, Daming Li et al.
· 1 citation