#natural language process...
Jun 2026
Can LLM-as-a-Judge Reliably Verify Rubrics in Agentic Scenarios?
RuVerBench is introduced, the first benchmark for assessing LaaJ reliability in rubric verification for agentic scenarios, and the impact of key LaaJ strategies, including prompt design, batching, and majority voting, on rubric verification is analyzed.
Yangda Peng, Yunjia Qi, Hao Peng et al.
· arXiv.org · 2 citations