Skip to content
Preprint

SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation

Jul 2026 · 1 citation · 54 references
Computer Science

TL;DR

Experiments show that SearchEyes achieves state-of-the-art performance among open-source multimodal search agents, with SearchEyes-27B improving over the strongest open-source baseline by 6.2 points on average.

Abstract

Training multimodal search agents to perform multi-hop reasoning remains challenging due to a fundamental structural disconnect: existing pipelines construct training data, search environments, and reward signals independently, causing synthesized structural metadata to be discarded, environments to rely on irreproducible external engines, and RL rewards to remain sparse at the trajectory level. We present \textbf{SearchEyes}, which uses a typed knowledge graph as the backbone of a \emph{simulated search world} that unifies all three components. We propose \textbf{Perception-Knowledge Chains (PKC)} to sample constrained multi-hop paths over the visual-knowledge intersection of Wikidata5M, retaining hop-level entity metadata that simultaneously defines a self-contained search world and step-level reward anchors. We further propose \textbf{Hop-Anchored Policy Optimization (HaPO)}, which reuses these anchors for step-level credit assignment without a separately trained process reward model. Experiments on six multimodal knowledge-intensive benchmarks show that SearchEyes achieves state-of-the-art performance among open-source multimodal search agents, with SearchEyes-27B improving over the strongest open-source baseline by 6.2 points on average.%

View source

Similar papers

#artificial intelligence Preprint Aug 2026

LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO

LiteSearch-VL is a low-compute recipe for Qwen3-VL-2B and Qwen3-VL-4B that uses only released OpenSearch-VL trajectories, parameter-efficient LoRA adapters, and synthetic step-level preferences, identifying answer verification, not search depth, as the next bottleneck for small multimodal agents.

Saeed Khaki, Nima Safaei, Kamal Ginotra · 0 citations
#artificial intelligence Preprint Aug 2026

WeAgent-MMSearch: Native Text-Vision Interaction for Multimodal Search Agents

WeAgent-Harness, a multimodal agentic harness that supports native text-vision interaction and runtime recovery, and WeAgent-MMSearch, an integrated system spanning data construction, agentic post-training, and multimodal rollout that outperform similarly sized open-source models and rival models with roughly ten times...

Zongkai Liu, Hui Zhang, Li-Qiang Niu et al. · 1 citation
Preprint Aug 2026

DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents

DeepVoyager-VL is proposed, a long-horizon multimodal deep-search framework for vision-in-the-loop search that constructs a multimodal event graph to drive data synthesis, yielding problems with intermediate visual dependencies and long reasoning chains.

Huan-Yao Zhang, Jie-Peng Zhou, Ru Zhao et al. · 0 citations
Jul 2026

SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Task

SearchArt is introduced, a scalable framework for training long-horizon search agents through verification-driven task synthesis and a multi-stage post-training pipeline, which exhibits adaptive search planning, iterative evidence aggregation, and complex reasoning over extended interaction horizons.

Lang Mei, Xiao-Han Yu, Chong Chen et al. · 1 citation
Jul 2026

DeepSearch-World: Self-Distillation for Deep Search Agents in a Verifiable Environment

DeepSearch-Evolve is presented, a self-distillation framework for web agents built on DeepSearch-World, a deterministic and verifiable environment with reproducible search and page-reading tools that enables scalable self-evolution for long-horizon web agents.

Xinyu Geng, Xuanhua He, Si-Xiang Chen et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.