This work argues that closing this gap requires alignment at every level of the pipeline, including execution, supervision, optimization, and evaluation, rather than scale alone, and presents Wuying-Browser-Agent, a unified framework that addresses each of these levels.
Abstract
Browser agents perform well on short, clean demonstrations, but real deployment is fundamentally different: agents must sustain dozens of decisions on live websites while recovering from mistakes and navigating complex UIs. We argue that closing this gap requires alignment at every level of the pipeline, including execution, supervision, optimization, and evaluation, rather than scale alone. We present Wuying-Browser-Agent, a unified framework that addresses each of these levels. A structured browser harness provides stable execution primitives and decision-oriented context management. Reflection and UI-specialized Curriculum SFT (RUIC-SFT) explicitly trains on recovery trajectories and complex-UI interactions. Divergence-Aware Online GRPO (DAO-GRPO) improves long-horizon credit assignment through potential-based reward shaping and divergence-aware step weighting. Finally, we introduce BrowserBench, a bilingual real-web benchmark of 350 tasks averaging 37.9 steps, because most existing benchmarks are too short to expose long-horizon failure modes. Wuying-Browser-Agent-27B achieves 80.6\% on WebVoyager, 66.7\% on Online-Mind2Web, and 65.1\% on BrowserBench, establishing a new open-source state of the art on browser-use benchmarks. The same pipeline also transfers beyond browser use, demonstrating strong general agentic ability and reaching an average score of 73.8 on Tau2-Bench, Claw-Eval, and BFCL-v4.
CAP is introduced, a scalable benchmark for evaluating browser agents on cross-site, human-like web tasks that require non-trivial UI interactions and visual understanding and a decomposition-and-recomposition pipeline that first abstracts each website into a structured site card capturing user-facing functions, comple...
BrowserForge is presented, a framework that generates web interaction data at scale by driving many browser sandboxes in parallel over the open web, and fine-tuning a compact multimodal model on this corpus raises its success rate on the live Online-Mind2Web from 25.66% to 33.33% and consistently improves step accuracy...
Fei Tang, Hua-Wen Shen, Zhiqiong Lu et al.· 0 citations
Investigation to Act (P2A) is introduced, an active probing framework for the browser-agent loop that addresses an asymmetric bridge between symbolic DOM hypotheses and screenshot layout by rendering on-demand symbolic DOM structure back into pixels.
Ke-Liang Li, Heng Wang, Chen Hu et al.· 0 citations
This paper evaluates six strong browser-use agents, three GUI-only agents that see only screenshots, and humans, evaluating the construction of challenging instances from tasks agents already solve, turning difficulty into a programmable property of the environment.
Xun-Jian Yin, Tian-Chen Guan, Jin-Ao Wang et al.· 0 citations
Experiments show that UI-Mate-27B sets a new open-weight state of the art on general computer-use benchmarks, substantially improving long-horizon reliability, and makes three contributions to an environment-grounded training stack with in-context demonstration learning.
Zihan Ding, Long-Xu Dou, Qixiao Gao et al.· 1 citation
A Python harness mirroring the autonomy axis is released so that future methods can be added directly to the leaderboard, and four patterns emerge: Spider gains transfer unevenly to BIRD and Spider~2.0; autonomy buys robustness at non-trivial cost; reasoning internalization sits between answer-only decoding and externa...
Changruo Zhao, Zujun Peng, Yu Tian et al.· International Conference on...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.