Generative reward models (GRMs) are important for LLM optimization. Unlike scalar reward models, GRMs generate natural-language critiques alongside preference judgments, providing finer-grained evaluation signals. Their effectiveness depends heavily on critique reliability. However, existing GRM training typically uses...
Xuan-Cheng Li, Bei-Ning Wang, Hai-Tao Li et al.· 0 citations
This work proposes LifeMem, a longitudinal memory framework that combines structured life-event retrieval with agent-specific parametric memory for experience integration, and shows that LifeMem improves alignment with human data in terms of response distributions, overall and within-group diversity, and patterns of wi...
Hexi Wang, Yu-Jia Zhou, Bangde Du et al.· 0 citations
Experimental results across two ranking scenarios demonstrate that explicitly modeling permutation-level differences improves the effectiveness and stability of listwise ranking, with particularly favorable performance in limited-feedback and complex list-level optimization settings.
Yi-Teng Tu, Wei-Hang Su, Zi-Tao Su et al.· arXiv.org· 0 citations
This work introduces LexRubric, a rubric-based benchmark for evaluating open-ended Chinese legal tasks and evaluates 18 recent general and legal-domain LLMs on LexRubric, showing that different models exhibit distinct capability profiles, and that open-ended legal tasks remain challenging for current LLMs.
Yifan Chen, Haitao Li, Yiran Hu et al.· arXiv.org· 1 citation
GenRubric is introduced, a self-evolving framework that improves rubric generation from unlabeled queries without requiring additional human annotations during self-evolution, and experiments show that self-evolution improves the agreement between evaluations induced by generated rubrics and those induced by expert-wri...
Yifan Chen, Hai-Tao Li, Qing-Yao Ai et al.· 3 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.