Teacher-Anchored Worst-case Stability Distillation for Membership Privacy
Knowledge distillation (KD) enables efficient deployment of deep learning models. However, it can increase privacy risks by making the student more vulnerable to membership inference attacks (MIAs), as the student may inherit patterns specific to the teacher’s private training data. Existing KD-based methods against MI...