Zichao Li

Probabilistic Scene Graph Prompting: Uncertainty-Aware Structured Reasoning in Multimodal LLMs

Scene graphs provide structured visual knowledge that can enhance multimodal large language models (MLLMs) for tasks like visual question answering and image captioning. However, existing approaches inject scene graphs as deterministic, hard prompts, ignoring the inherent uncertainty in visual perception, leading to ov...