Bernhard Scholkopf

ABC: Advantage-Based Control Variates for Reinforcement Learning with Verifiable Rewards

Recent progress in reinforcement learning with verifiable rewards (RLVR) has highlighted the effectiveness of simple critic-free policy-gradient methods such as Group Relative Policy Optimization (GRPO). In contrast, actor-critic methods rely on learned value functions whose approximation error can introduce bias throu...