On-Policy Residual Learning for Diffusion Language Models
ORL is introduced, a framework for on-policy residual learning in DLMs that learns from model-induced residual trajectories on the fly and introduces an entropy-contraction objective that sharpens predictions as the model revisits its own predictions.