Preprint
Oct 2026
RailWave: Adaptive Spatial and Temporal Scheduling for Expert-Parallel Communication
Irregular All-to-All communication is a major bottleneck in expert-parallel Mixture-of-Experts (MoE) models. Even with fixed expert routing and placement, uneven utilization of parallel network Rails and incast can limit communication performance. We present RailWave, a phase-adaptive communication layer built on DeepE...
Chu-Tian Wang, Wen-Hao He, Jing-Min Zhu et al.
· 0 citations