Beyond Accuracy: How Procedural Traces Shift the Decision Criterion of LLM Overseers
Organizations increasingly use oversight loops where one large language model (LLM) audits another's outputs alongside procedural traces of claimed steps. A common concern about such LLM-as-a-judge pipelines is that detailed traces make overseers gullible. Using signal detection theory, we audit five LLM overseers on 1...
Zi-Han Chen, Di Zhu, L. Zheng et al.
· 0 citations