Skip to content
Conference

MuCRE-TextVQA: Mamba-enhanced uncertainty-aware counterfactual relational executor for text visual question answering

Aug 2026 · International Conference on Machine Learning and Unmanned Systems · Vol 14307, pp. 143070I - 143070I-8 · 0 citations · 13 references
Engineering

TL;DR

This study focuses on spatial-relation cases, where cross-modal alignment and relation drift are especially severe, and MuCRE-TextVQA combines USG, CFT, Hybrid Mamba2, and CRE, with CRE serving as the main relation-execution component.

Abstract

Text-based visual question answering (TextVQA) jointly interprets image content, scene text, and natural-language questions from both fixed-vocabulary and OCR-derived answer spaces. This study focuses on spatial-relation cases, where cross-modal alignment and relation drift are especially severe. MuCRE-TextVQA combines USG, CFT, Hybrid Mamba2, and CRE, with CRE serving as the main relation-execution component. With the updated results, MuCRE improves spatial-subset accuracy from 0.3774 to 0.3936 while reaching 0.4449 overall accuracy; CFT alone remains slightly higher in overall accuracy (0.4491). The claimed advantage is therefore relation-sensitive reasoning rather than uniformly best overall performance.

View source

Similar papers

Open access Sep 2026

PKSF: A Task-Aware Prior Knowledge Selection and Fusion Framework for TextVQA

This work proposes a TextVQA framework that integrates external prior knowledge to support multimodal reasoning and demonstrates that this approach effectively leverages external knowledge to improve performance on knowledge-intensive questions.

Zan-Xia Jin, Pinle Qin, Jia Qin et al. · 0 citations
#artificial intelligence Preprint Sep 2026

DocHop: Benchmarking Out-of-domain Multi-hop Reasoning in Information-Dense Documents

This work introduces DocHop, a benchmark for integrated chart--context reasoning in document-style images and constructs DocHop via a stochastic logic-first generation pipeline with controllable reasoning depth and visual density, to enable systematic evaluation.

Zhuoran Yu, Le Thien Phuc Nguyen, Jaden Park et al. · 1 citation
#artificial intelligence Preprint Sep 2026

When Helpful Text Hurts: Option-Redirecting Bias in Vision-Language Models

In tri-modal visual question answering (VQA), auxiliary text is commonly used to complement visual and textual inputs, yet its reliability is often uncontrolled. While prior work studies modality conflicts in general, it remains unclear how different types of unreliable auxiliary text affect answer selection under fixe...

Tam Le Thi Thanh, Van Tran Hoang, Hong-Hanh Nguyen-Le et al. · 0 citations
#natural language process... Preprint Aug 2026

OCR-MetaReasoning Benchmark: Evaluating the Meta-Reasoning Ability of MLLMs in Text-Rich Image Understanding

Experiments with representative closed-source and open-source MLLMs show that OCR-grounded meta-reasoning remains far from saturated: models struggle with visible-rule application and layout-sensitive inference, while process-compliant rationales can accompany incorrect final answers under exact-match evaluation.

Geng-Xu Li, Yuan Wu, Yi Chang · 0 citations
Open access 2026

Speaking ITM’s Language: Query Reformulation and Temporal-MMR for Long-Video QA

The resulting training-free pipeline, RECAST, consistently outperforms recent frame-selection baselines without modifying the ITM encoder, and preserves the per-frame matching cost of a standard single-query baseline.

S. Han, Thang Vu, Junyeong Kim · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.