AOE (Arranged and Organized Extraction), a bilingual benchmark that evaluates LLMs'ability to distill long-form, multi-document inputs into structured tables, is introduced, revealing that structured extraction from long contexts remains a fundamental challenge - an"Area of Effect"(AOE) that impacts all tested systems.
Tian-Yun Zhong, Guozhao Mo, Yan-Jiang Liu et al.· arXiv.org· 0 citations
Inspired by the human cognitive planning process, HintNav-igator achieves state-of-the-art performance among open-source LLM agents, surpassing proprietary model Claude-3.5 Sonnet on the WebArena benchmark.
Guozhao Mo, Yan-Jiang Liu, Yafei Shi et al.· 0 citations
AdaRAS (Adaptive Reasoning Activation Steering), a lightweight test-time framework that improves reasoning reliability by selectively intervening on neuron activations during inference, enhancing incorrect reasoning traces while avoiding degradation on already-correct cases.
Fang Dong, Zu-Ming Yan, Xuri Ge et al.· arXiv.org· 5 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.