AOE (Arranged and Organized Extraction), a bilingual benchmark that evaluates LLMs'ability to distill long-form, multi-document inputs into structured tables, is introduced, revealing that structured extraction from long contexts remains a fundamental challenge - an"Area of Effect"(AOE) that impacts all tested systems.
Tian-Yun Zhong, Guozhao Mo, Yan-Jiang Liu et al.· arXiv.org· 0 citations
Atria Dawn Preview is introduced, a foundation agentic language model designed for scientific research and engineering workflows, with the goal of expanding the frontier of agent productivity in the real world.
Inspired by the human cognitive planning process, HintNav-igator achieves state-of-the-art performance among open-source LLM agents, surpassing proprietary model Claude-3.5 Sonnet on the WebArena benchmark.
Guozhao Mo, Yan-Jiang Liu, Yafei Shi et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.