Can David Beat Goliath? On Multi-Hop Reasoning with Resource-Constrained Agents
David-GRPO addresses the challenge of small language model agents under the budget constraint of commodity GPUs by placing a handful of off-policy expert trajectories into the GRPO groups of the early updates, and rewarding evidence coverage and resumes the most promising partial trajectory.