Beyond Accuracy: Evaluating Evidence Grounding in Multimodal Large Language Models for Newspaper Understanding
Although multimodal Large Language Models (LLMs) perform well on document question answering tasks, Answer Correctness, i.e., whether a model’s answer is correct with respect to the question, does not fully describe model behavior because it does not show whether answers are supported by relevant evidence. This paper p...