Ying-Ping Wang

DoubleFree:Exploiting Exploration History for Rollout-Free Multi-Task LLMs Training

Multi-task post-training can develop domain specialists through independent reinforcement learning (RL) and consolidate their capabilities through multi-teacher on-policy distillation (MOPD). However, standard MOPD generates on-policy student responses and keeps multiple teachers online throughout consolidation, introd...