Auditing Medical Vision-Language Models on Chest Radiographs: Estimating Reference Agreement Across Institutions
Three generative vision-language models were evaluated on three institutional chest-radiograph corpora and six findings under two elicitation protocols, comprising more than 345,000 finding-level predictions, and estimated finding-by-direction reference agreement at a receiving institution from a small budget of local...