We study training LLM judges from natural language feedback, especially for subjective tasks where the verdict depends strongly on which evaluation criteria the judge invokes and how it weighs them. The dominant approach, outcome-supervised RL (e.g., GRPO), credits every token in the rollout with a single scalar determ...
Ilgee Hong, Chang-Long Yu, Zhenghao Xu et al.· 0 citations
SafeGEO is constructed, an evaluation suite with 22 GEO attack variants across 600 recommendation cases that empirically show that GEO attacks can promote flawed target products and whether agent-side design choices can mitigate this risk.
Qian-Feng Wen, Y. Liu, Xin Liu et al.· arXiv.org· 5 citations· ⚡1
This work proposes Process-Scorer Guided Adaptive Tree Rollout (PATR), a quality-aware rollout framework for multi-turn agent RL that uses task-appropriate process feedback to score partial trajectories, selectively branches from promising states, reuses shared prefixes, and conservatively stops degenerate paths to red...