The Artificial Societies Benchmark is introduced to help researchers assess whether synthetic populations support their intended analyses and helps researchers identify which aspects of a synthetic population can support their analysis and where researchers need further human evidence.
Edoardo Chidichimo, Min-Ju Jung, Felix P. S. Wallis et al.· 1 citation
Vietnamese speech research is constrained by resources that isolate automatic speech recognition from speaker, dialect, code-switching, and deepfake analysis. We introduce VietPrism, an open, multi-domain corpus that brings these dimensions together at scale: 993.4 hours and 403,941 bona fide utterances from 1,262 veri...
Many-shot in-context learning (ICL) enables large language models (LLMs) to adapt to complex tasks by conditioning on thousands of demonstration examples, but this paradigm shifts the inference efficiency bottleneck to the key-value (KV) cache memory. Due to the linear scaling behavior of the KV cache, storing these in...
You-Peng Zhao, Tian Tan, Li-Qian Peng et al.· 0 citations
It is argued that behavioral evaluation understates what models encode, while probing alone overstates what they deploy, in a three-level evaluation framework measured on the same items under the same binary decision.
Zhen-Yan Lu, He Wang, Xiao-Hui Huang· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
We present ChunkRank, an open-source Python library that derives chunk boundaries from a target model's tokenizer and context window, and selects an answer among candidates produced independently per chunk. It ships a validated registry of 90 models across 15 providers and six answer-selection methods, and needs only t...
Amit Nautiyal, Ayush Bhatt, Gaurav Nautiyal· 0 citations
Results show that task-informed subspace construction can be effective for low-resource speech adaptation, and that adaptive rank allocation provides a robust way to improve parameter efficiency without increasing model capacity.
Asmee Mishra, Meng-Jie Qian, Brechtje Post et al.· 0 citations
It is suggested that a cascade of judges succeeds only when its judges make complementary errors, and that future decision models should be designed afresh with that aim.
D. Rao, Christopher Callison-Burch· arXiv.org· 12 citations· ⚡1
AI-workflow governance cannot be reduced to checking the final answer: an apparently safe answer may rest on a fragile evidence path that ordinary evaluation cannot see, localize or govern, so SSEG moves governance below surface-level output checking into auditable, path-specific decisions about intervention, revalidat...
M. Dixon, Bertrand Nortier, Miquel Noguer I. Alonso· 0 citations
The effectiveness of hybrid text privatization is demonstrated, which leverages the promise of DP in an efficient, usable manner and effectively reduces re-identification risks in clinical texts while being producing more coherent and usable output texts, leading to higher privacy-utility trade-offs.
Ibrahim Baroud, Stephen Meisenbacher, Sebastian Möller et al.· 0 citations
A black-box, inference-time diagnostic that tells these two cases apart without retraining or annotation is introduced, with the pattern holding on English-Marathi and English-Tamil, with the failure modes tracking the post-edit distribution rather than MT quality or language family.
Isuru Wijesiri, Nisansa de Silva, Kavindu Warnakulasuriya et al.· 0 citations
LLMersion is proposed, a scheme for AI for education that runs entirely at home, over the learner's own documents, with an AI-written, AI-understood, AI-updated codebase anyone can customize; and presents LLMersion-1, a released open-source prototype.
Qi-Ming Guo, Jin-Wen Tang, Xing-Ran Huang et al.· 0 citations
This paper applies speech act and politeness theory to a corpus-pragmatic analysis of 2,000 English-language prompts drawn from publicly shared ChatGPT conversations, showing a consistent movement toward indirect, implicit, and fragmentary realizations of directive force, accompanied by a decline in politeness marking.
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.