CulturalMenuBench shows that near-perfect recognition can conceal an inability to apply cultural knowledge, motivating training that explicitly connects perception, procedure, and cultural context.
Bo Zeng, Lin-Feng Gao, Pei-Qing Lin et al.· 0 citations
The results show that structured agent memory need not generate an intermediate representation of the past, and Zero-Mem achieves competitive performance while eliminating LLM calls and LLM-token consumption from memory operations.
TIDE-Bench is introduced, a benchmark for conversational text-to-SQL under chain ambiguity and intent drift evaluation, targeting two recurring patterns: chain ambiguity, where an underspecified question triggers layered clarification with conditional dependencies, and intent drift, where the user retracts and replaces...
Yu-Jia Liu, Jia-Yan Lin, Zi-Jin Hong et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.