Equilibrium Forcing: Adaptive Video Generation Without Noise Conditioning
TL;DR
Equilibrium Forcing is introduced, a simplified framework for video denoising generative models without noise level conditioning that pioneers modular training- and inference-time designs for noise-unconditional generation that decouple learning the denoising field from sampling.
Abstract
Standard autoregressive video generation algorithms based on Diffusion and Flow Matching rely on rigid training objectives and static sampling schedules, limiting inference procedures from adapting to the data. We introduce Equilibrium Forcing (EqF), a simplified framework for video denoising generative models without noise level conditioning. EqF pioneers modular training- and inference-time designs for noise-unconditional generation that decouple learning the denoising field from sampling. This flexibility allows for inference-time algorithms that operate in a closed loop by adapting to feedback from the sample, improving video quality and consistency on challenging autoregressive video generation benchmarks. Extensive analysis elucidates exactly how removing the noise level conditioning enables EqF's data-dependent inference properties to surpass the performance of standard noise level-conditional denoising video methods.