We are witnessing the emergence of Agentic Software Engineering (SE~3.0), where AI agents act as autonomous AI Teammates performing complex tasks such as coding, debugging, and testing. As AI Teammates generate a vast new category of digital artifacts, they introduce unique opportunities and challenges related to human-AI collaboration, trustworthiness, and economic impact. This workshop serves as the premier forum for addressing these challenges, anchored by the launch of the AIDev dataset. Comprising over one million agentic pull requests generated by AI Teammates such as Claude Code, OpenAI Codex, and GitHub Copilot, AIDev provides the empirical evidence needed to understand the behaviors of AI Teammates. This workshop features insights from major industry players and academic pioneers, and aims to define a roadmap for a world where AI Teammates and human developers build the future together.
Hao Li, Haoxiang Zhang, Jie M. Zhang et al.· Proceedings of the 32nd ACM...· 0 citations
The first controlled longitudinal study that isolates the scaffolding’s contribution to agent quality over time is conducted, revealing that despite continuous development activity and growing codebase complexity of the scaffoldings, there is no statistically significant improvement in SWE-bench benchmark score across releases for a given fixed LLM version.
This paper empirically study the development and release evolution of five major open-source agent harnesses, revealing extreme release velocities exceeding two releases per day and thousands of issues within months, and performs the first controlled longitudinal study that isolates the agent harness contribution.
O. Sghaier, Hao Li, Bram Adams et al.· 2 citations