Double-Rollout Reinforcement Learning with Sampling-based Reward Estimation
Reinforcement learning with verifiable rewards (RLVR) implemented with Group Relative Policy Optimization (GRPO) has driven substantial progress in training reasoning language models. However, verifiable outcome rewards provide an imperfect measure of reasoning quality: a correct final answer may not be supported by th...
Hai-Feng Qian, David Mosallanezhad, Christian Munley et al.
· 0 citations