Preprint
Aug 2026
Serving Masked Diffusion LLMs: Characterization and Design Principles from Real Hardware
Results show that serving diffusion language models needs parallelism at the level of each denoising step, which differs from AR serving in how admission and eviction interact with an already shared forward pass.
Farhana Amin, Sabiha Afroz, Mona Moghadampanah et al.
· 0 citations