Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion
This paper theoretically analyzes the MaskGIT sampler for image modeling, revealing its implicit temperature sampling mechanism, and shows that MaskGIT is asymptotically equivalent to a choose-then-sample (CTS) formulation, instantiated as the "moment sampler," which explicitly separates index selection from token samp...