M. Kollmann

Beyond Sample Copying: Structural Memorization in Diffusion Models

It is shown that diffusion models progressively overfit the denoising training objective, creating a generalization gap between validation and training performance at intermediate noise levels and that predictions made from intermediate trajectory states occupy a distinct feature-space regime from predictions made from...