Skip to content

Author

Jing-Yuan Li

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Nov 2026

A Per-Step Load-Balancing Engine for Expert-Parallel MoE Serving

In expert-parallel Mixture-of-Experts serving, a layer finishes only when the most loaded GPU of its group does. Token routing shifts at every decode step and concentrates on a few experts, so most of the group's reserved GPU time waits on stragglers. Recovering that time means re-deciding, at every layer of every deco...

Jing-Yuan Li, Mao-Lin Wang, Hayden Kwok-Hay So · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.