What Should a Self-Teacher See? Privileged Context Design for On-Policy Self-Distillation
This work compares the student view and training fixed within each scale against three abstractions compiled offline, a named strategy, a method-independent framing, and a problem category, and against an answer-only control that keeps the destination but removes the path.
Kang-Hui Tian, Si-Yuan Liu, Tianxiang Jiang et al.
· 2 citations