Validating LLM judges for automated oversight of patient communication
A stakeholder-informed seven-criterion evaluation rubric spanning safety, reliability, and communication quality is developed and benchmarked 19 LLM judges across multiple implementation strategies, supporting LLM judges for scalable patient communication oversight while demonstrating the need for recalibration to pati...