Xue-Kun Zhang

SCOPE: Selective Critical-Step On-Policy Self-Distillation for Agentic Reinforcement Learning

Outcome-based reinforcement learning provides coarse supervision for long-horizon LLM agents: failed trajectories may contain correct steps, while successful trajectories can contain errors. Trajectory-level skills can also shift teacher preferences at unrelated steps, introducing off-target distillation signals. We in...