AdvantageFlow: Regularized Advantage-Weighted RL in Flow Models
The algorithm minimizes an advantage-weighted prediction loss, which maximizes reward, regularized by the rollout policy, which convexifies the objective and makes its optimization stable, and compares it to both forward- and reverse-process RL algorithms.
Branislav Kveton, Anup B. Rao, Subhojyoti Mukherjee et al.
· 0 citations