Yunghyun Kim

Advancing Entropy-Level Credit Assignment in RLVR via Proximal Entropy Policy Optimization

Value-model-free RLVR methods such as GRPO assign uniform advantages to all tokens in a rollout, ignoring that tokens contribute unequally. Recent methods use token entropy as an importance proxy but compute it globally across the batch, conflating importance with prompt difficulty and positional trends. We argue that...