PRISM-VLM is introduced, a multi-axis discriminative benchmark that scores every item along seven axes covering the recurring failure modes (task quality, behavioral robustness, and capability bottlenecks) and combines them into a single PScore, with items recycled from fifteen public benchmarks.
AraGenre is a shared task on hierarchical, definition-guided Arabic genre classification, motivated by the limited availability of annotated data in Arabic and other low-resource languages. Systems assign each Arabic text segment both a broad communicative genre and a fine-grained specific genre. The released training...
Mo El-Haj, Saad Ezzini, Shadi Abudalfa et al.· 0 citations
MORSE is introduced, a compression-aware method for evidence-preserving context ordering that improves evidence retention over reverse ordering and generally outperforms matched random search, with downstream QA gains.
Ke Wan, Yi-Fan Wang, Li-Heng Lai et al.· 0 citations
A bilingual evaluation suite of 231 Vietnamese--English question--answer pairs from Vietnamese labour law is introduced, and six automatic diagnostics for faithfulness to retrieved evidence are introduced, covering citations, modality, exceptions, procedures, conclusions, and evidential support.
Chi Minh Nguyen, Mo El-Haj, T. Nguyen et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Planned Test-Time Scaling (PTTS) provides a general framework for improving test-time scaling by coordinating reasoning branches, with zero-shot and trainable instantiations that yield substantial performance gains.
Xue-Qing Wu, Lang-Xing Bai, Hritik Bansal et al.· 0 citations
It is argued that the appropriateness of a response offset, whether delayed silence or anticipatory overlap, is conditional on the speaker's latent intent, identifiable only from that speaker's behavior.
RoPA Manager, a system for automated RoPA information extraction using hybrid retrieval that combines lexical ranking over tsvector, dense-vector search, Reciprocal Rank Fusion (RRF), and locally deployed LLMs, is proposed.
To Duy Hinh, Anh Le Quoc Nguyen, Tri Van Phan et al.· 0 citations
Web agents are usually evaluated in live environments, where environment state and judge models drift between runs, so the same checkpoint rarely reproduces the same score, making controlled studies of training phenomena impractical. We present WebMRE, an offline benchmark of 541 tasks and 5,293 steps derived from succ...
Cheng-Guang Gan, Yun-Hao Liang, Qing-Hao Zhang et al.· 0 citations
Ruby-ASR is presented, which refines the conventional target into a span-bound orthographic--lexical-reading sequence and shows that refining the recognition target can improve lexical-reading recovery without sacrificing readable orthographic transcription.
Hao Shi, Yun Liu, Xue-Hao Yang et al.· 0 citations
This work studies whether task-specialist models should be handled by separate task-specialist models or by a single model trained through multi-task training, sequential updates, or model merging, and concludes with practical guidelines for selecting fine-tuning strategies in real-world settings.
ChinaUnicom DataAgent (UniDataAgent) is presented, an ontology grounded system for reusable question-to-report analysis that separates semantic acquisition from online execution and has the potential to be replicated in other enterprises.
Yu-Tai Duan, Ya-Hui Zhao, Zhang-Ti Li et al.· arXiv.org· 0 citations
A method for distilling sequential computation by replacing spans of input tokens with collapsed representations, computed on the fly by a lightweight merge module, allowing pretrained models to operate on compressed inputs without architectural changes or re-training.
Zi-Xuan Lan, Jessica Yang, Yan-Hong Li et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.