AssetOpsBench: A Real-World Evaluation Benchmark for AI-Driven Task Automation in Industrial Asset Management
An automated evaluation framework that uses three key metrics to analyze architectural trade-offs between the Agent-As-Tool and Plan-Execute paradigms, along with a systematic procedure for the automated discovery of emerging failure modes is introduced.
Dhaval Patel, Shuxin Lin, James T. Rayfield et al.
· Proceedings of the 32nd ACM... · 17 citations
· ⚡3