Seung-won Hwang

Can David Beat Goliath? On Multi-Hop Reasoning with Resource-Constrained Agents

David-GRPO addresses the challenge of small language model agents under the budget constraint of commodity GPUs by placing a handful of off-policy expert trajectories into the GRPO groups of the early updates, and rewarding evidence coverage and resumes the most promising partial trajectory.