Aranya Saha

Skip What You Can Predict: Predictive Repositioning for Policy Optimization for Efficient LLM Training

Predictive Repositioning for Policy Optimization is introduced, which uses two observed optimizer transitions to estimate a farther point along the same-batch optimization trajectory, moves partway toward that point, evaluates the original objective there, and applies a corrective update, giving PrePO a fixed active co...