LLM Judges as Raters: A Pre-Registered Audit of Severity, Halo, Reliability, and Version Instability in LLM Essay Scoring on Public Corpora
This work treats LLM judges as raters and runs a pre-registered rater-effects battery on public corpora in two languages, finding no credible evidence that judge halo exceeds the trained-human range.
Veerendra Kumar Sunkavalli
· 0 citations