Bo-Fei Huang

Seeing is not Enough: Vision-Language Models Perceive Evidence but Fail to Act

Vision-language models (VLMs) perform strongly on visual question answering benchmarks, yet often make decisions that contradict visual evidence they have already identified correctly. We distinguish perceptual failure, where relevant evidence is not recognized, from process failure, where recognized evidence fails to...