Jul 2026
Distilling large language models for code generation via ranking supervision.
This work proposes a distillation approach based on ranking supervision that consistently outperforms supervised fine-tuning as well as FKL and RKL baselines in Python code generation, multilingual generation, and data-science scenarios and offers guidance for future research in model compression.
Zhe Ding, Hui Ji, Su Pan et al.
· Neural Networks · 0 citations