FrontierMat, a benchmark of 330 problems drawn from frontier academic and industrial research in fields including aerospace, semiconductors, embodied intelligence and nuclear fusion, is introduced, providing a testbed for measuring progress toward language models that support frontier materials R&D.
Feng Chen, Jian-Guo Huang, Yu-Shan Xiao et al.· 0 citations
Retrieving the right skill from a large library is essential for LLM agents, yet requests and skills are written for different purposes and in different words. Existing retrievers narrow this request-skill gap with one or two representation choices each, so it is unknown whether their gains hold in combination. No prio...
Tian-Yi Sun, Peng-Fei Yao, Yan-Ze Wang et al.· 0 citations
EvoAgentBench is introduced, a benchmark for agent self-evolution via Ability-guided transfer across four agentic domains: web research, algorithmic reasoning, software engineering, software engineering, and knowledge work, which shifts self-evolution evaluation from aggregate accuracy comparison to fine-grained diagno...