Vijay Kumar

Rethinking LLM-Guided Visual Question Answering: Does Deeper Knowledge Integration Really Help?

Some questions about an image need commonsense or factual knowledge that its pixels do not contain. Large Language Models (LLMs) can supply this knowledge to Visual Question Answering (VQA) systems, but the depth at which their guidance should enter a vision-language model remains unclear. We prompt the 70-billion-para...