Mingyuan Zhou

Mitigating Exploration Bias in RL for Multi-Instruction Following

Two metrics to measure the exploration bias in instruction following are proposed and a two-stage framework to alleviate it is introduced: Behavioral Bootstrapping, a lightweight rejection sampling fine-tuning stage before RL to activate hard instructions; and Scarcity-Aware Rewards, a new RL reward function that assig...