Assessment of Clinical Empathy by an LLM-as-a-Judge: Bias Patterns in ATENA and a Replicable Audit Protocol for Medical Simulation
Background: Automated assessment of relational competencies by large language models (LLMs) is gaining traction in medical education, yet its empirical reliability remains poorly documented. Methods: We evaluated ATENA, a GPT-3.5-Turbo virtual-patient simulator deployed at the Faculty of Medicine of Nice (France), in t...