Rewarding Efficient Reasoning Improves Abstention on Underspecified Tasks in Reasoning Models
This work takes inspiration from a resource-rational perspective on human cognition and introduces a novel GRPO reward that encourages efficient reasoning about whether the task contains all the information needed to solve it, leading to human-like abstention performance gains.
Polina Tsvilodub, M. Höth, Michael Franke et al.
· 0 citations