This work formalizes task-agnostic environment preprocessing, in which a studying system explores an environment under a budget and produces artifacts for a frozen solver, and compares unaided and archive-equipped meta-agents with fixed synthetic-practice and corpus-processing methods across six heterogeneous benchmark...
Vinay Samuel, Varun Ursekar, Vijay S. Kalmath et al.· 0 citations
Reliable Enterprise Agent Deployment (READY), a framework for qualifying AI agents for deployment on enterprise workflows, and provides a basis for comparing agent systems, setting oversight requirements, and making evidence-based deployment decisions.
Veronica Chatrath, Bryan Zhu, Jing-Xuan Fan et al.· 0 citations
CliniCARE-Bench is the first deployment-oriented clinical-agent benchmark to jointly evaluate real longitudinal EHR investigation, claim-level evidence grounding, governing-policy use, process adherence, and calibrated abstention within a common patient-level adjudication framework.
Veronica Chatrath, Bryan Zhu, George Pu et al.· 1 citation
This work evaluates 5 frontier LLMs as optimizers both under a shared coding harness and under their native harnesses across 4 downstream tasks, and establishes harness optimization as a measurable and discriminative capability with large space for improvement.
Varun Ursekar, Apaar Shanker, Yash Maurya et al.· 5 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.