Skip to content

UNIBROWSE: A Data-to-Agent Framework for Multimodal BrowseComp

Jul 2026 · arXiv.org · Vol abs/2607.10557 · 0 citations · 23 references
Computer Science

TL;DR

UNIBROWSE, a unified data pipeline that for the first time simultaneously generates training data covering all three information-flow patterns, augments curated knowledge graphs with live web retrieval for improved fidelity, and introduces a novel metric of exploration degree to filter low-signal instances for efficient reinforcement learning is introduced.

Abstract

Multimodal BrowseComp tasks require agents to combine perception, tool use, and long-horizon reasoning over dynamic web content, challenging their ability to handle compositional structure, open-world uncertainty, and multimodal integration across extended interactions. Crucially, real-world multimodal browsing involves three distinct information-flow patterns: text-only, image-to-text, and text-to-image, yet existing data construction methods cover only the text-only and image-to-text patterns, leaving text-to-image largely unaddressed and limiting agent generality and robustness. We introduce UNIBROWSE, a unified data pipeline that for the first time simultaneously generates training data covering all three patterns, augments curated knowledge graphs with live web retrieval for improved fidelity, and introduces a novel metric of exploration degree to filter low-signal instances for efficient reinforcement learning. Through this pipeline, we produce high-quality cold-start tool-use trajectories and exploration-rich QA pairs, and train a 35B-scale agent via supervised fine-tuning and exploration-aware RL.The resulting UNIBROWSE agent achieves state-of-the-art performance on multimodal BrowseComp benchmarks, attaining an average accuracy of 54.4 across five diverse benchmarks -- an improvement of 10.5 points over its base model Qwen3.5-35B-A3B -- and surpassing serveral closed-source agent workflows such as GPT-5 (42.9), Gemini-2.5 Pro (44.8), and Gemini-2.5 Flash (41.3).

View source

Similar papers

#artificial intelligence Preprint Aug 2026

WeAgent-MMSearch: Native Text-Vision Interaction for Multimodal Search Agents

WeAgent-Harness, a multimodal agentic harness that supports native text-vision interaction and runtime recovery, and WeAgent-MMSearch, an integrated system spanning data construction, agentic post-training, and multimodal rollout that outperform similarly sized open-source models and rival models with roughly ten times...

Zongkai Liu, Hui Zhang, Li-Qiang Niu et al. · 1 citation
Preprint Sep 2026

WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editing

This work presents WeAgent-MMGenEdit, a full-stack recipe including a multimodal harness, a scalable data construction pipeline, a comprehensive benchmark, and post-training methods for the agent policy and image backend that enables a 30B-total/3B-active policy to outperform similarly sized policy models and approach...

Hui Zhang, Zongkai Liu, Li-Qiang Niu et al. · 1 citation
#artificial intelligence Preprint Sep 2026

MM-ContextFold: Context Folding for Multimodal Agentic Retrieval

MM-ContextFold is proposed, a training-free framework that loads raw images only when needed and maintains a persistent, text-only main context for high-level planning and spawns ephemeral branch contexts for image-dependent subtasks.

Yang Tian, Fan Liu, Jing-Yuan Zhang et al. · 0 citations
#computer vision Preprint Sep 2026

Qwen3.8-Omni: Towards Native Omni-Modal Agents

This work introduces Qwen3.8-Omni-Flash, a natively multimodal agentic model for real-world multimodal productivity and releases Qwen-Live-Harness, an open-source framework for building responsive, real-time multimodal agents based on Qwen3.8-Omni-Flash.

Yifan Yang · 1 citation
Preprint Sep 2026

MintAct: A Unified Visual Agent for Digital Environments

We present MintAct, a family of vision-language models that unifies UI grounding, multi-step navigation across mobile, desktop, and web, and visual tool use, trained at 2B, 4B, and 8B scales. Through careful design of our environments, data, and training recipes, MintAct models match the performance of per-domain speci...

Ming-Fei Gao, Rui Tian, Hai-Ming Gang et al. · 0 citations
Conference Aug 2026

PolyRAG: A Multi-Agent Multimodal Retrieval-Augmented Generation System for Heterogeneous Document Intelligence

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by reducing hallucinations and improving factual accuracy. Most RAG implementations, however, are restricted to a single data modality. Real-world document collections span PDFs, spreadsheets, audio, video and images simultaneously. This paper i...

S. Vijayan, Sushila Palwe, Devendra Joshi · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.