Rethinking How We Evaluate Methodological Progress in Health AI
It is found that aggregate pairwise comparisons transfer strongly across evaluation settings, including from randomly generated tasks to clinically meaningful tasks and across datasets, and at the same time, clinically meaningful tasks exhibit greater task-method interaction.
Florent Pollet, Matthew B. A. McDermott
· 1 citation
· ⚡1