DoMoE: Domain-Aware Semantic Expert Prediction for Efficient MoE Inference Under Expert Offloading
DoMoE is proposed, a domain-aware MoE inference system that exploits domain locality in inference workloads and organizes routing information into domain-specific expert routing tables, restricts semantic matching to domain-relevant tokens and explicitly balances prediction accuracy against prediction overhead.