RL Forgets! Towards Continual Policy Optimization
This work introduces MRCL, a Multimodal Reasoning Continual Learning benchmark, and proposes Continual Policy Optimization (CPO), a replay-free framework grounded in a prior-task behavioral KL objective that consistently reduces forgetting while preserving, and in some cases improving, pretrained model capabilities.