Skip to content

From Score Learning to Discretized Sampling: An End-to-End Generalization Analysis of Diffusion Models

Jul 2026 · arXiv.org · Vol abs/2607.23226 · 2 citations · 42 references
Computer Science Mathematics

TL;DR

This work establishes a unified convergence and generalization framework for score-based diffusion models parameterized by practical ResNet-type architectures and quantitatively characterize how the training sample size, temporal discretization grids, and optimization accuracy jointly control the final fidelity of samples generated by diffusion models.

Abstract

Despite the empirical success of score-based diffusion models, a complete theoretical understanding of how finite-sample learning, network parameterization, and numerical discretization jointly dictate generative quality remains underdeveloped. Existing sampling analyses often evaluate the generative performance conditional on an oracle score or a pre-specified error threshold. In this work, we establish a unified convergence and generalization framework for score-based diffusion models parameterized by practical ResNet-type architectures. We analyze the generalization and convergence properties from the practical finite-sample, discrete-time learning problem of the score function to the ideal continuous-time, population-level objective. Based on the generalization result of the learning problem of score function, we analyze the sampling process induced by the learned score function and provide an end-to-end total variation distance estimate for the generated terminal distribution. This estimate explicitly decomposes the overall generative error into four interpretable components: the truncation error of the forward process, the reverse-time discretization error, the generalization error incorporating both finite data and forward-time discretization, and the training optimization gap. Our results quantitatively characterize how the training sample size, temporal discretization grids, and optimization accuracy jointly control the final fidelity of samples generated by diffusion models.

View source

Similar papers

Preprint Aug 2026

A Plug-in Interpretation of Conditioning in Score-Based Diffusion Models

A conditioning mechanism for diffusion models based on multi-speed joint diffusion of the target and the condition learns an unconditional joint score network and enforces conditioning at inference via a plug-in correction term, and derives explicit conditional reverse-time SDEs and approximate probability-flow ODEs.

Libo Chen, Souvik Ghosh, Teo Deveney et al. · 0 citations
Preprint Oct 2026

Improving score-based sampling via affine post-processing

Sampling from a probability distribution with access only to its log-density is a foundational problem in statistics, machine learning, and the physical sciences. This problem is studied in the data-free score-based diffusion literature, which samples the target density via estimating scores of densities produced by co...

Curtis McDonald, Kevin Rojas, Mo-Lei Tao et al. · 0 citations
#data science Preprint Sep 2026

FluxLite: Inference-Time Proposal Control for Discrete Diffusion Models

FluxLite is introduced, a lightweight, training-free proposal-control framework for discrete diffusion, identifying a tilted-path coverage factor that governs robustness to score error, together with finite-particle convergence for a fixed controlled Feynman-Kac recursion.

Yinuo Ren, Haoxuan Chen, Grant M. Rotskoff et al. · 1 citation
#machine learning Preprint Sep 2026

Leveraging Inference-Time Compute for Diffusion Models via Global Scheduling of Denoising Trajectories

The analysis from independent random search to a broader family of local search operators, and it is proved that when sensitivities vary across instances, no adaptive policy can avoid worst-case regret that grows linearly in the trajectory length.

Yuan Cao, Yi-Fu Tang, Hang-Qi Li et al. · 0 citations
#machine learning Preprint Oct 2026

Sample complexity bounds for categorical Markov random fields via Discrete Diffusions

Many applications in statistics, economics, and physics require sampling from high-dimensional categorical distributions with local dependence structures. Examples include finite memory language models, Ising and Potts systems in statistical physics and protein folding, etc. In modern machine learning, discrete diffusi...

Shivam Kumar, Nabarun Deb · 0 citations
#machine learning Preprint Sep 2026

Robustness of Diffusion Models under Distribution Shift

This work studies robust score estimation under Wasserstein perturbations of a reference distribution of Ornstein--Uhlenbeck diffusion and characterize how finite data, intrinsic dimension, and distribution shift affect the robustness of score-based diffusion models.

Wei Luo, N. K. Chada, Shi-Jie Zhang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.