Skip to content

Multimodal Graph-of-Thoughts: Hypothesis-Verification Graphs for Multimodal Reasoning in Vision-Language Models

· 0 citations · 22 references

TL;DR

Multimodal Graph-of-Thoughts (MM-GoT) is introduced, a training-free, verification-constrained inference framework that integrates cross-modal grounding directly into hypothesis graph search and consistently outperforms chain-of-thought reasoning baselines under matched inference budgets.

View source

Similar papers

Jul 2026

Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding

This work introduces Spatially-Grounded Thought Tokenization to explicitly align special tokens with spatial locations for clear spatial correspondence and visual interpretability, and proposes Mixture-of-Thought-Tokens, a new free-form multimodal grounding method that bridges the perception-reasoning gap.

Tianyi Gao, Han Fang, Tianyi Ding et al. · 0 citations
Preprint Aug 2026

GLaQ: Grounding Latent Queries in Visual Evidence for Multimodal Reasoning

GLaQ, a grounded latent-query framework that replaces sequential latent rollout with a fixed set of context-conditioned queries grounded in the original visual tokens, is introduced, suggesting that direct query-to-image grounding can recover localized evidence from the full image without external visual operations or...

Ze-Sheng Yang, Lingling Zhang, Xinyu Zhang et al. · 1 citation
#computer vision Preprint Sep 2026

From Vision to Language: Investigating Causal Information Flow in Multimodal Decision-Making

This work investigates cross-modal information flow in a video-based generative multiple-choice-like setting by applying a layer-wise causal intervention on video-text attention pathways and identifies a distinct pattern in temporal reasoning.

Davide Testa, Hugh Mee Wong, Alessandro Lenci et al. · 0 citations
#natural language process... Preprint Aug 2026

M$^3$R-Bench: A Unified Benchmark for Evidence-Grounded Multimodal Metaphor Understanding

M$^3$R-Reasoner is proposed, which combines curriculum-based reasoning supervision with task-aware reinforcement learning to align model reasoning with metaphor interpretation and improves Visual Evidence and Sentiment Justification scores over GPT-5.

Hongye Jiang, Jun-Nan Zhu, Jing-Wang Huang et al. · 0 citations
Preprint Sep 2026

Reasoning with Image Generation

Across six diverse visual reasoning tasks including multi-view spatial reasoning and collision prediction, ReImaGin consistently outperforms both text-only reasoning and specialist vision-tool baselines, with gains of up to 25\%, demonstrating the advantage of flexible, generative visual reasoning.

Nishad Singhi, H. P. Rodriguez, Aditya Arora et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.