Learn from the Gap: Differential-Aware Advantage Pruning with Adaptive Rollout Sampling for GRPO
This work proposes FastRL, a novel plug-and-play reinforcement learning framework that simultaneously improves training efficiency and the effectiveness of policy learning, and introduces an advantage-aware pruning strategy to selectively preserve high-advantage trajectories while maximizing inter-trajectory gradient d...
Jia-Hua Yang, Zhiwei Yang, Xian-Peng Zhang et al.
· 0 citations