Preprint
Aug 2026
Thinking at the Right Size: Amortized Distillation Across Post-Trained LLMs
ADAPT---Amortized Distillation Across Post-Trained LLMs is introduced, a framework for amortizing distillation across both axes of a model family: size and post-training variant, producing models for interpolated sizes across post-trained variants with a single distillation run.
Yan Zhou, Sara Kangaslahti, Jonathan Geuter et al.
· 0 citations