Probabilistic question-answering systems -- whether large language models (LLMs) themselves, retrieval-augmented generation (RAG), or trained multi-hop retrievers -- conflate"what is known"and"how to reason"into a single probabilistic computation: hallucination cannot be eradicated, evidence chains cannot be audited, a...
Yu Ren, Shao-Heng Fan, Tao Wang et al.· 0 citations
Hidden diffusion trajectories are established as actionable signals for selective test-time reasoning repair and LOCKR, a hidden-state trajectory-guided planner that decides when to allocate additional computation, expands a structured set of targeted repair branches, and selects the most promising continuation using t...
Guoshenghui Zhao, Tan Yu, Wei-Jie Zhao· 0 citations
Text-to-speech systems increasingly process user-generated text (UGT) such as ppl and imo, whose pronunciation must be inferred from the canonical rather than surface form. We introduce UGTPhon, the first grapheme-to-phoneme (G2P) benchmark for UGT in English, Vietnamese, and Korean, together with an inference-grounded...
Minju Jeon, Youngha Park, Han Sung Park et al.· 0 citations
Evidence that evaluation material entered training does not reveal how much it affected evaluation. This distinction leaves a contaminated benchmark score difficult to interpret: provenance can establish contact, but only a counterfactual can quantify the performance attributable to that contact. We present LeakScale,...
Divyansh Singh· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
The results show that context representations following the principled approach can reduce reliance on model scale, pointing toward a future of AI systems with frontier-level performance powered by smaller models.
Michael Theologitis, Dean Light, S. Li et al.· 0 citations
Tempered Evidence Fusion (TEF) is proposed, a training-free rule that weights each sentence's log-odds by its normalized information gain, as derived from a generalized Bayesian posterior, making the fused score nearly vanish for uncertain sentences while preserving the Bayes-optimal weight of decisive evidence.
Yu-He Wu, Rui Qian, Guang-Yu Wang et al.· 0 citations
Results show that out-of-domain generalization remains a major bottleneck and highlight the effectiveness of recent Arabic-specialized speech models, multimodal dialect identification approaches, and ensemble methods.
Peter Sullivan, Bashar Talafha, Ahmed Ashraf et al.· 4 citations
Post-hoc analyses quantify changes in answers and submitted evidence, and show when aggregate accuracy and evidence-coverage rates miss the claim-level pattern, as well as revealing changes that endpoint and aggregate metrics leave unresolved.
We introduce the Illinois Social Attitudes Aggregate Corpus (ISAAC), an open, modular, and accessible corpus of 527 million+ English-language Reddit posts selected for relevance to six key social group distinctions based on race, sexuality, age, ability, body weight, and skin tone, covering the 17-year period from 2007...
Babak Hemmatian, Sarah Hadjarab, Jessica Chen et al.· 0 citations
LEGO is proposed, a dual-module framework that synergizes Legal Expert GraphRAG and expert Chain-of-thought for complex legal reasoning that achieves the best results among the evaluated baselines on the open-ended benchmarks.
Qing-Jing Chen, Jun-Kai Zhang, Shao-Chun Wang et al.· 0 citations
Under this setup, learned planning is a weak relevance signal rather than a replacement for strong retrieval, and packing-order and score-flatness analyses did not identify a stable mechanism.
Ying-Rui Li, Han-Xiu Chen· Proceedings of the Seventh W...· 0 citations
A sentence-level benchmark for evaluating the ability of LLMs to classify interpretive canons as articulated by Larenz in the tradition of Savigny is contributed, operationalizing this conception of interpretation as classification criteria.
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.
