Yi-Yang Wang

Do As I Do, Not As I Say: On-Policy Distillation Inherits the Teacher in Vision-Language Models

Improving the reasoning capabilities of vision-language models (VLMs) often relies on post-training with supervision from stronger models. Two common strategies are supervised fine-tuning (SFT), which trains on teacher-generated demonstrations, and on-policy distillation (OPD), which provides teacher feedback on trajec...