Roman Nykonov

SAEP-SVD: Sign Alignment and Energy Preservation for Stable Distillation of Extreme High-Rank Models

SAEP-SVD (Sign Alignment and Energy Preservation) introduces a novel matrix distillation framework designed for high-rank compression of Diffusion Transformers (DiT, Z-Image, FLUX) without feature collapse, bypassing the classical constraints of the Eckart–Young–Mirsky theorem. Key Technical Highlights: Sign & Phase Al...