MedRoundsQA: A Persona and Difficulty Aware Evaluation for Multi-Turn Medical Consultations
Evaluations of fifteen LLM doctor agents show that moving from a single-turn diagnosis on the standardized records to multi-turn consultations causes large degradations, highlighting equity risks that single-turn benchmarks miss.
Youssef Mohamed, Ahmed Heakl, Qin-Rong Cui et al.
· 0 citations