Training high-quality diffusion models is computationally expensive, and inference-time guidance often adds further sampling cost. In this work, we introduce Swift, a simple yet effective self-guided training method that uses a frozen weak denoiser to improve a stronger model without adding inference overhead. For each...
Yan-Jin He, Cui-Feng Shen, Wan-Zhou Lei et al.· 0 citations
SCOPE is a training-free sparse attention framework that combines 3D-RoPE-aligned key subspace clustering with online per-head Top-$k$ estimation for efficient video-DiT inference and consistently outperforms existing training-free baselines in both fidelity and latency.
Qi Zhao, Qi-Rui Li, Hanlin Tang et al.· 0 citations
A causal interpretability framework is introduced that reveals that the tokens encoding semantics at the input need not be those that maintain them during generation, but also provides a causal view of internal mechanisms in diffusion transformers.