Federated Distillation: A Survey
Federated learning (FL) enables collaborative model training without centralizing clients’ raw data, but parameter exchange can impose substantial communication costs and usually requires compatible model architectures. Federated distillation (FD) instead transfers predictive or intermediate knowledge through knowledge...
Li Lin, Jianping Gou, Baosheng Yu et al.
· ACM Computing Surveys · 4 citations