Chi-Dieu Bui

Efficient Model Pruning via Selective Layer-wise Distillation with Dynamic CKA-based Weighting

Deploying deep convolutional neural networks in resource-constrained edge environments necessitates aggressive model compression. While iterative block-level pruning paired with multi-stage Knowledge Distillation (KD) is a common strategy, traditional KD approaches rigidly enforce static, uniform loss weightings, leadi...