Nicolas Macris

Denoising Score Matching in Diffusion Models: The Effect of Rank Constraints on Generalization

Architectural biases restrict the class of functions that a diffusion score network can represent, but their effect on generalization remains poorly understood. We study denoising score matching with score networks having a rank constrained non-linear term and a linear skip connection. Numerical experiments with traina...