Anchoring What Matters: A Dual-Level Learning Framework for Visually-Grounded Multimodal Reasoning
PIVOT introduces a self-calibrated experience replay mechanism, which selectively collects and replays visually-grounded historical experiences as stable reference anchors for policy optimization, and designs a vision-guided advantage allocation mechanism to allocate additional vision-aware advantages to tokens based o...