Jul 2026
LLM Judges Can Be Too Generous When There Is No Reference Answer
The results emphasize the need for calibrating the LLM judges with a sample with reference-aware evaluation before using them in reference-free setups reliably, and the methodology provides a blueprint for researchers and practitioners in doing such calibration of LLM judges for other tasks.
Chalamalasetti Kranti, Sowmya Vajjala
· arXiv.org · 1 citation