Batch-Paced: Fixed-Budget Batch Decoding in Discrete Diffusion Language Models
As generative language models become more capable and widely used, inference demand grows, making efficient serving increasingly important. Discrete diffusion language models (dLLMs) offer a promising path to more efficient inference through parallel token generation. Prior dLLM decoding methods, however, focus on impr...
Shuai Zhang, Zhan-Chao Zhou, Hua-Chuan Qiu et al.
· 0 citations