Behind Aggregate Scores: What Systematically Varying Arena-Hard's LLM Judge Reveals
It is shown that similar aggregate scores can conceal substantial changes in individual verdicts, both when the same setup is repeated and when the instructions change.
L. Yorke
· 1 citation