Jul 2026
Agreement Is Not Quality: Blind Expert Verification of Human and LLM Qualitative Coding When Human Consensus Is Not Ground Truth
Significant empirical evidence is provided that agreement-based evaluation is insufficient for automation decisions, and the study demonstrates a transferable verification protocol and a code-level division-of-labor framework.
Alex X. Liu, Lief Esbenshade, Michael Xiao et al.
· arXiv.org · 2 citations