UBEP: Re-architecting Expert Parallelism Communication Library for Production Superpods
UBEP (Unified-Bus Expert Parallelism), a production-ready communication library that rethinks MoE's All-to-All primitives for modern superpod architectures, and reduces All-to-All latency by up to 52% and MoE inference Time Per Output Token (TPOT) by up to 11.1%.