When retrieved evidence contradicts an agent's prior beliefs, does it revise its answer, acknowledge uncertainty, or persist with an incorrect conclusion? Existing evaluations of agentic systems focus primarily on task success, offering limited insight into how agents handle such conflicts. We propose to evaluate agent...
Kaiser Sun, Bernal Jiménez Gutiérrez, Hong-Jun Liu et al.· 0 citations
This work introduces HASP (Harnessing LLM Agents with Skill Programs), a new framework that upgrades skills into executable Program Functions (PFs) that act as executable guardrails that activate on failure-prone states and modify the next action or inject corrective context.
DerivAudit is introduced, a framework for auditing whether a memory is actually supported by the history available when it was written, whether supporting evidence lies beyond writer-provided citations, whether the composed memory introduces unsupported meaning, and how write-time admission decisions affect later memor...
Hong-Jun Liu, Chen Zhao· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.