Across 4,500 full-duplex calls and five voice configurations, Spanish, Portuguese, and Hindi remain within 3.2 task-completion points of English, but Korean and Mandarin fall by 14.7 and 8.4 points, respectively.
Soham Ray, Edgard dos Santos Paiva, Rubén Valenzuela et al.· 0 citations
A 200-task voice benchmark spanning 10 entity types, controlled difficulty, caller realisms, and three environments is introduced, identifying strategy selection and successful recovery as the central bottlenecks in exact spoken entity collection.
The $\tau^\tau$-bench (pronounced hyper-tau-bench), a benchmark that makes agent construction the task, is introduced to turn the work of cooperative agent building into a measurable target for coding agents.
Shi-Xiu Quan, Keshav Dhandhania, Karthik R. Narasimhan et al.· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.