Agentic AI systems combine large language models, information retrieval, planning, and tool use to act on behalf of users in complex digital environments. Evaluating such systems under laboratory conditions remains challenging because real-world environments are hard to control: executing AI agents in them is neither s...
Martin Potthast, U. Kruschwitz, M. Granitzer et al.· Proceedings of the 35th ACM...· 0 citations
User simulators promise to evaluate conversational search systems at a scale human studies cannot reach, but only if their behavior is realistic enough to trust. We study AutoSim, a conversational-search user simulator whose relevance judgments rank a controlled pool of retrieval systems in agreement with NIST across t...
S. Zerhoudi, Jelena Mitrović, M. Granitzer· 1 citation
Knowledge Triage, a framework that classifies each line of an agent's knowledge base by type and routes each type through its own retention policy, is addressed, and AgentArtifactCorpus, the classifier, and the reference implementation are released.
S. Zerhoudi, Jelena Mitrović, M. Granitzer· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.