Intent drift is established as a measurable multi-turn failure mode and explicit state maintenance as a partial mitigation and IntentFlux is introduced, an executable benchmark that converts verifiable tasks into dialogues with controlled intent changes while preserving their original graders.
Yan-Jie Zhang, Bo-Wen Cao, Zi-Xin Chen et al.· 1 citation
Everyday human-LLM interaction is not only answer delivery or cognitive offloading; it also contains measurable, selective and conditionally organized behavioural signatures of informal learning, which shift AI evaluation toward the preservation of cognitive opportunities for users to reason, test ideas and construct u...
This work presents TACT (Taxonomy-Aligned Conversational Tutor), a human-grounded framework for post-training and evaluating pedagogically adaptive ESL tutors and develops two complementary taxonomies: the Tutor-Strategy Taxonomy with 13 tutor response strategies and the Student-Move Taxonomy characterizing learner beh...
Dongjie Yang, Siya Lin, Leixian Shen et al.· 0 citations
WILDTRACE is introduced, a benchmark of 481 tasks over 214 naturally occurring long-form sources such as technical incident reports and lesser-known literary narratives, where all evidence trails arise from the document's own causal, temporal, and narrative logic.
Zixin Chen, Peng Liu, Haobo Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.