Alfaj Uddin Ahmed

Teaching Vision-Language Models to Decline: Support Completion Against Mirage

Vision-language models answer questions about images they were never shown, a failure called mirage. Such an answer can be correct without being justified by the evidence, and the difference matters wherever a model's output is checked by someone who did not see its input. We locate the failure in the training objectiv...