What Lies Beyond Perception: A Partition Theory of the Limits of AI Evaluation and Oversight
Replacing the judge can move a benchmark score, and models can be trained to hide capabilities. Both put the evaluator in question: what can it certify? We develop a partition theory of evaluation from one principle: judgement is bounded by perception. An agent's discrimination is the partition of its inputs into class...
A. Mahran
· 0 citations