ActionOPD: Distilling Decisions, Not Tokens
This work introduces ActionOPD, an action-level on-policy distillation method motivated by maximizing expected teacher-action likelihood at student-encountered states, and establishes ActionOPD as a promising approach to agent distillation.