Privacy and Security in Knowledge Distillation for Federated Learning: A Survey
Knowledge distillation (KD) is increasingly used in federated learning (FL) because it enables clients to exchange predictions, features, prototypes, or synthetic knowledge rather than full model parameters. This change can reduce communication and support heterogeneous models, but it also changes the privacy and secur...