Prateik Pothuneedi

The Anatomy of a Blind Spot: What an LLM Judge Must Be Shown, and How Much

Evaluation of text generated by large language models (LLMs) is increasingly delegated to LLMs acting as judges, yet what such a judge must be shown remains unresolved. We treat a judge whose reports are acted on as a regulator, in the sense of cybernetics, and ask what it must be shown, how much, in what form, and wha...