Exploring multi-answer visual question answering with object detection: a systematic review
TL;DR
This systematic literature review (SLR) focuses on multi answer VQA systems and the use of object detection, following the PRISMA 2020 guidelines and proposes a taxonomy of multi-answer VQA organized along four dimensions.
Abstract
Visual question answering (VQA) is a challenging research area that enables machines to answer natural language questions based on visual content by jointly understanding images and text. Conventional VQA systems typically produce a single answer for each image–question pair. However, many real world visual questions are ambiguous or complex, allowing multiple valid answers to exist. This systematic literature review (SLR) focuses on multi answer VQA systems and the use of object detection, following the PRISMA 2020 guidelines. We analyzed 58 peer-reviewed journal articles retrieved from the Scopus database published between 2020 and 2025. Ten of these studies clearly stated that generating multiple answers was their main goal. Forty-eight others indirectly supported answer variability by using object-based or multi-instance reasoning. Through this review, we examine the current methodologies for supporting multi-answer generation, including model architecture, datasets, and evaluation metrics. Most multi answer generation approaches utilize attention mechanisms, graph neural networks, and transformer-based models. Additionally, we propose a taxonomy of multi-answer VQA organized along four dimensions. Limitations are identified in datasets and evaluation metrics (i.e., answer ambiguity/subjectivity). Future research should focus on improving model interpretability and designing an evaluation framework that incorporates subjective and context-sensitive responses.
