Skip to content
Preprint

WorkSurface-Bench: Benchmarking Enterprise Agents on Multi-Surface Knowledge Routing

Jul 2026 · 0 citations · 25 references
Computer Science

TL;DR

WorkSurface-Bench is introduced, a benchmark for evaluating the capability of heterogeneous knowledge sources as surface routing in enterprise agents, and shows that correct surface selection is necessary but insufficient for task completion.

Abstract

Enterprise agents often need to integrate heterogeneous knowledge sources: documents for narrative facts, tables for computation, and dependency graphs for file relationships. Existing benchmarks typically evaluate retrieval or tool use without distinguishing whether an agent first selects the appropriate knowledge sources. We introduce WorkSurface-Bench, a benchmark for evaluating this capability as surface routing. It contains 1,151 atomic tasks derived from persona-scoped Workspace-Bench-Lite workspaces, spanning document, table, graph, and cross-surface questions. Its reference answers are auditable: table answers are reproduced through executed DuckDB queries, document answers are grounded in verified text spans, and graph answers are traced to source dependency annotations. We evaluate four model backbones across six controlled agent settings, yielding 27,624 protocol-error-free trajectories. Under gold-constrained tool access, agents achieve 98.7-99.8 Route F1, while Answer remains only 56.1-75.3 percent, showing that correct surface selection is necessary but insufficient for task completion. Matched interventions further show that surface hints improve Answer for three of four models, whereas removing irrelevant tools primarily improves routing and efficiency. In an independent three-annotator audit, all 200 sampled tasks pass all six quality criteria by majority vote, with 192 receiving unanimous judgments on every criterion. We release the dataset, construction pipeline, scoring code, and agent harness at https://github.com/haolpku/WorkSurface-Bench.

View source

Similar papers

Preprint Aug 2026

GABench: A Comprehensive Benchmark for Evaluating LLM Agents on Graph Analysis Tasks

GABench is introduced, a comprehensive benchmark for agentic graph analysis that covers four graph analysis task categories: graph retrieval, graph theory, graph machine learning, and graph open-ended question answering and provides practical insights into the development and evaluation of LLM agents for graph analysis...

Jiarui Tan, Zhong-Jian Zhang, Yabo Guo et al. · 2 citations
Preprint Aug 2026

Schema-Agnostic Graph Reasoning Agent for Hybrid Knowledge Graphs

GRA is presented, a Graph Reasoning Agent that explores hybrid knowledge graphs, whose nodes are either textual concepts or relational tables, with seven generic tools, discovering everything domain-specific at run time.

M. Dragić, Ruben Ifrah, Alexandre Rio · 0 citations
#machine learning Preprint Aug 2026

ClosureBench: A Constructive Benchmark for Compositional Graph Reasoning

ClosureBench is introduced, a constructive benchmark for compositional graph-relational reasoning with programmatically verified ground truth with programmatically verified ground truth: each task's reference answer is computed by executing a program in the Ein tensor-logic language, ensuring machine-verified correctne...

S. Goria · 0 citations
Preprint Jul 2026

Learning Compositional Meta-Routing for Agentic Workflows: An Executable Benchmark

This work introduces an executable benchmark and a budget-aware meta-router that composes heterogeneous operations from raw task text that establishes a reproducible testbed and a bounded proof of concept, not evidence of live-LLM performance.

Natan Vidra, Alina Kapanova, Arun Kanhai et al. · 0 citations
#artificial intelligence Book Open access Aug 2026

Cost-Effective Repository Exploration for Agentic Issue Localization

The results support treating repository exploration as an independently measurable and budgetable stage of modular coding agents, with explorer selection guided by the downstream handoff contract.

Mohammad Nour Al Awad, Sergey Ivanov · 1 citation
Preprint Aug 2026

ForestBench: A Unified Graph Framework for Evaluating Multi-Agent Collaboration

This work introduces a generalizable evaluation framework that maps native MAS traces into a shared space of unified collaboration graphs, enabling different methods to be evaluated under the same representation, reference set, and metric panel.

Guo Chen, Ziwen Li, Reed Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.