PTGPO: Prefix Tree Group Policy Optimization
Training language agents on long-horizon interactive tasks is challenging because sparse terminal rewards provide weak credit signals for intermediate actions. Existing group-based methods either assign a shared trajectory-level advantage or estimate step-level advantages from state groups, which may conflate the curre...
Ruo-Lin Chen, Yang Li, Ji-Hang Wang et al.
· 0 citations