Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillation
S-OPD is a simple multimodal on-policy distillation framework that explicitly strengthens student perceptual learning through two objectives: Teacher-calibrated Policy Contrast separates student policies under original and masked images with teacher-based token-level gating, strengthening the student's reliance on visu...