Beyond Pseudo-Labels: Dual-Level Knowledge Distillation for Enhanced Deep Clustering
This study introduces a novel clustering approach, namely Teacher–Student-based Deep Clustering (TSDC), that relies on intra- and inter-distillation-based feature representations. In fact, TSDC distils knowledge from (i) high- to low-response channels, forcing the latter to mimic the former, and (ii) deeper to shallowe...