We have 4 of 54 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
ExplorationBench turns the wicked problem of evaluating scientific exploration into a concrete and tractable framework built on verifiable Alien Worlds, and finds that the strongest systems can acquire and apply unfamiliar rules, while performance varies substantially across trajectories and continued exploration can s...
CCTU, a benchmark for evaluating LLM tool use under complex constraints, is introduced and nine state-of-the-art LLMs are evaluated in both thinking and non-thinking modes, showing that models violate constraints in over 50% of cases.
SPIEval is introduced, a human-curated benchmark grounded in five cognitive capabilities that exposes fundamental limitations of current LLM-based mobile assistants and motivates future research in this direction.
AgentGym2 is presented, a new evaluation framework with task instances grounded in real-world end-to-end working demands that measures agents'ability to execute end-to-end procedures, discover tools via exploration, compose tools for unseen tasks, and remain robust to noisy and underspecified information.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
