Md. Abdul Awal

MoEKD: Advancing Robustness, Performance, and Behavioral Fidelity in Compressed Code Models via Mixture-of-Experts Knowledge Distillation

Large language models for code have achieved strong performance across diverse software analytics tasks, yet their real-world adoption remains limited by high computational demands, slow inference speeds, significant energy consumption, and environmental impact. Knowledge distillation (KD) offers a practical solution b...