Zhihan Huang

Provably adaptive sampling with uniform and remasking discrete diffusion models

This work considers a first-order sampler based on the leave-one-out denoiser for uniform and remasking processes whose coordinate updates can be performed in parallel, and derives an exact information-theoretic representation of the discretization error in terms of the mutual information between different coordinates of the forward process at different times.