Skip to content

DocIntent: Answerability-Guided Agentic Restoration for Real-World Document Visual Question Answering

Aug 2026 · 0 citations · 40 references
Computer Science

TL;DR

DocIntent, a training-free Answerability-Guided Agentic Restoration framework, which first assesses question answerability, then identifies task-relevant degradations and selectively invokes restoration tools, and which consistently improves the average score and consistency of different open- and closed-source MLLMs.

Abstract

Real-world degradations such as blur, shadow, distortion, and moire patterns severely impair the document question-answering capabilities of Multimodal Large Language Models (MLLMs). Applying restoration tools before Visual Question Answering (VQA) is an intuitive solution. However, existing restoration approaches remain limited, as manually designing and executing restoration strategies is labor-intensive and requires domain expertise. Agentic restoration offers new possibilities for automation, yet existing frameworks primarily target natural images and pursue perceptual quality, overlooking that restoration should serve downstream tasks rather than optimize generic image quality metrics. To this end, we explore the value of agentic restoration for real-world degraded document VQA and propose DocIntent, a training-free Answerability-Guided Agentic Restoration framework. DocIntent first assesses question answerability, then identifies task-relevant degradations and selectively invokes restoration tools. A Comparison-Based Rollback mechanism validates each restoration step and reverts it when question-relevant evidence becomes less decipherable. The entire process requires no additional pretrained degradation classifier or image quality assessment model. Extensive experiments on the WildDoc benchmark show that DocIntent consistently improves the average score and consistency of different open- and closed-source MLLMs. The code and experimental data will be publicly available.

View source

Similar papers

Preprint Aug 2026

Doc-REFRAG: Rethinking Multimodal Document Retrieval-Augmented Generation

Doc-REFRAG, a question-guided framework that compresses visual tokens into coarse chunks and selectively expands question-relevant ones via a lightweight RL-based selector, is proposed, achieving state-of-the-art accuracy with significantly lower inference latency.

Ruofan Hu, Sheng Xu, Min-Jie Hong et al. · 0 citations
Preprint Sep 2026

SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration

SkillIR is proposed, a skill-guided framework that represents restoration experience as degradation-centered action evidence rather than complete tool-use trajectories rather than complete tool-use trajectories and improves restoration quality and enables more reliable and effective tool use.

Jie Shao, Sheng-Kai Hu, Xu Zhang et al. · 0 citations
Preprint Sep 2026

Beyond OCR Accuracy: Text-Centric VQA Under Image Degradation with Modular and End-to-End

An empirical study comparing two modular pipelines with SA-DBNet, a custom detector architecture combining ResNet-18 with self-attention spatial modeling and deformable convolutions against an end-to-end vision-language baseline, evaluated on 4013 degraded images with 7000 question-answer pairs finds that conventional...

Ritali Vatsi, R. Jagadeesh, S. Baghel et al. · 0 citations
Preprint Aug 2026

InSight-doc: Agentic Visual Perception for Long-Document Understanding

This work proposes InSight-doc, an agentic visual perception framework that treats visual resolution as an adaptive reasoning-time resource that starts from low resolution and selectively zooms into high-resolution regions for finer evidence, without relying on any external retriever.

Kaican Li, Wei-Yan Xie, Lewei Yao et al. · 0 citations
#computer vision Preprint Aug 2026

ReVA: A Region-Aware Visual Assistant for Visually Grounded Question Answering

ReVA is proposed, a region-aware VQA model that employs a frozen CLIP ViT-L/14 Vision Transformer (ViT) and a Qwen2.5-7B-Instruct large language model (LLM) connected through a dual bridge that aligns both whole-image and region-level representations with the LLM's embedding space.

A. Senthil · 0 citations
#artificial intelligence Preprint Sep 2026

Think Before You Restore: Risk-Aware Manchu Manuscript Restoration with Stroke-Guided Attention

SAGE-Restore (Stroke-Aware Gated rEstoration), a selective restoration framework that first assesses where restoration is needed and then uses this assessment to guide restoration candidate generation and pixel-level selection, is proposed.

Ming-Qiu Liang, Dongdong Wang, Si-Yang Lu et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.