InfraDev: Can Coding Agents Develop AI Infrastructure, and How Can We Tell?
Coding agents are beginning to develop the production-grade AI infrastructure that trains and serves large models, yet existing benchmarks cover only single kernels or single-GPU tasks, and grade with tests and prompts that misjudge both correct and incorrect patches. We introduce InfraDev, a benchmark of 36 tasks buil...
Yang-Shen Deng, Jia-Qi Ruan, Ye-Qi Huang et al.
· 0 citations