One Block Ahead: Promoting Sampler State in Diffusion Language Models
Block-diffusion language models denoise a whole block of token positions in parallel so each forward pass can emit many tokens. However, blocks are still denoised in strict sequence, a cost that within-block acceleration leaves untouched. Here, we investigate decoding blocks concurrently and propose One Block Ahead (OB...
Yang-Yi Shen, Pin-Jui Ku, Nicolai Oswald et al.
· 0 citations