RECAP: Reciprocal Sparse Attention and Hierarchical Caching for Efficient Video Diffusion
Diffusion transformers generate high-quality videos but remain computationally expensive. Sparse attention and temporal caching reduce computation within and across denoising steps, respectively, offering a natural composition. However, predictions produced with sparse attention become sources for temporal reuse, coupl...