Aihua Zhu

Efficient controllable diffusion via dynamic hybrid attention and decoupled knowledge distillation

A dynamic hybrid attention (DHA) mechanism that integrates high-fidelity local modeling from self-attention with efficient global context aggregation from external attention, together with a decoupled knowledge distillation (DKD) framework for training the resulting heterogeneous architecture is proposed.