VERPO: Verified Evidence Regularized Policy Optimization
Verifiable outcome rewards guide language-model post-training, but sequence-level advantages do not identify which token-level decisions should be preserved or revised. Evidence-conditioned Teachers provide denser supervision by replaying sampled trajectories with privileged feedback. Yet indiscriminate imitation risks...
Hai-Jiang Li, Cheng-Yue Lv, Yi Zhang et al.
· 0 citations