SUP-MIMIC: A Multi-Task Clinical Diagnosis Benchmark for Evaluating LLMs'Robustness to Contradictory Evidence
SUP-MIMIC is proposed, a multi-task framework utilizing MIMIC-IV-v3.1 that comprises Basic Assessment, Diagnostic Divergence Task (DDT), and Diagnostic Convergence Task (DCT), designed to evaluate the model's"one-to-many"disambiguation capability among phenotypically similar cases, while DCT assesses the model's abili...