Reinforcement learning (RL) is widely used to sharpen reasoning in multimodal large language models (MLLMs), yet its effect on hallucination is uneven. We trace this to two weak points in the \emph{correction chain} from reward to parameter update. At the rollout level, hard queries---those with high semantic entropy--...
Ying-Xuan Zhuang, Miao Pan, Wang-Jie Gan et al.· 0 citations
UECR-GRPO is introduced, which integrates verifier and teacher signals within a single GRPO-style update at both the response and token levels and uses the signed teacher--old-policy token gap to redistribute the verifier-derived component.
Jie Zhang, Jing-Xiao Yang, Zhehao Huang et al.· 1 citation
Reinforcement learning for LLM agents involves two distinct optimization di- mensions: how environment feedback is exploited within a trajectory, and how complete trajectories are aggregated across a batch. We formulate these dimen- sions as Intra-Trajectory Feedback Attribution and Inter-Trajectory Objec- tive Aggrega...
Ying-Xuan Zhuang, Bin-He Yu, Jing-Xiao Yang et al.· 1 citation
TASPO, which converts privileged supervision into outcome-grounded action credit, is introduced and indicates that TASPO reduces supervision mismatch and that action-level assignment stabilizes the policy optimization process.
Jing-Xiao Yang, Wang-Jie Gan, Ying-Xuan Zhuang et al.· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.