#artificial intelligence
May 2026
Can Coding Agents Reproduce Findings in Computational Materials Science?
This work presents AutoMat, a benchmark for evaluating LLM-based agents'ability to reproduce claims from computational materials science, and curates a set of claims from real materials science papers to test whether coding agents can recover and execute the end-to-end workflow needed to support (or undermine) such cla...
Ziyang Huang, Yiyun Cao, A. Shargh et al.
· arXiv.org · 9 citations