What Does an Agentic Software Engineering Benchmark Measure? Profiling Task Demands and Agent Behaviour Beyond What Category Labels Reveal
The Spread--Novelty--Centrality (SNC) profile is introduced, a three-axis characterization of the demands of repository-level coding tasks, grounded in empirical software engineering research, and an unreliable proxy for task demands is introduced.
Radin Shayanfar, Keheliya Gallaba, Ahmed E. Hassan
· 2 citations