When Rubrics Fail: Hallucinations Reveal Blind Spots in Medical AI Evaluation
Hallucinations can undermine clinician trust in LLMs, making it important that evaluation methods capture clinically relevant errors. Rubric-based evaluation has become the leading approach for assessing LLMs in medicine, but it is unclear whether rubric scores reflect such errors. We first study this in a controlled s...
Griffin Farrow, Lily Sijia Li, Jack Johnson et al.
· 0 citations