Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Open access Oct 2026

Introducing Human-Centeredness in AI-Assisted Lexicography

This paper proposes a human-centered artificial intelligence (HCAI) framework for AI-assisted lexicography. While generative AI offers significant opportunities to enhance lexicographic work, it also raises concerns regarding the future role of lexicographers and the preservation of linguistic and cultural diversity. D...

Antonio San Martin, Catherine Trekker · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Pretrained self-supervised speech models can recognize unseen consonants

Modern pretrained self-supervised automatic speech recognition models are trained on large-scale audio data to encode speech into contextualized representations. However, their training data are heavily skewed toward high-resource languages with little data from low-resource languages, raising concerns about the potent...

Chihiro Taguchi, \'Eric Le Ferrand, Hirosi Nakagawa et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Learning to Attack and Defend: Adaptive Red Teaming of Language Models via GRPO

Language model safety must continually adapt to evolving attacks. Recent works have demonstrated that reinforcement learning can be used to train stronger attacker and defender models in tandem by applying PPO-style self-play and DPO-style online preference optimization. In this work, we explore the efficacy of GRPO in...

Blake Bullwinkel, Eugenia Kim, Amanda Minnich et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

LoRi: Low-Rank Distillation for Implicit Reasoning

Implicit chain-of-thought (iCoT) methods aim to internalize reasoning in large language models, but often underperform explicit CoT prompting. We empirically find that hidden-state reasoning trajectories exhibit low-rank structure. Motivated by this observation, we propose a low-rank distillation framework that transfe...

Ryan Solgi, Jiayi Tian, Zheng Zhang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems

Memory is essential for enabling large language models to support long-horizon reasoning, yet existing memory systems remain unreliable and difficult to debug. Tracing memory's dynamic evolution is crucial to understand how information is synthesized, propagated, or corrupted over time. In this work, we study the new p...

Xinle Deng, Ruobin Zhong, Hujin Peng et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

AI Appeals Processor: A Deep Learning Approach to Automated Classification of Citizen Appeals in Government Services

Government agencies must register, classify and route every citizen appeal within statutory time limits, and much of this work is still done by hand. We describe AI Appeals Processor, a classification and routing component deployed in a CPU-only government environment, and report what its evaluation and deployment taug...

Vladimir Beskorovainyi · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Imperative Interference: Social Register Shapes Instruction Topology in Large Language Models

System prompt instructions that cooperate in English compete in Spanish, with the same semantic content, but opposite interaction topology. We present instruction-level ablation experiments across four languages and four models showing that this topology inversion is mediated by social register: the imperative mood car...

Tony Mason · 0 citations
#artificial intelligence Preprint Open access Oct 2026

\$OneMillion-Bench: How Far are Language Agents from Human Experts?

As language models (LMs) evolve from chat assistants to long-horizon agents capable of multi-step reasoning and tool use, existing benchmarks remain largely confined to structured or exam-style tasks that fall short of real-world professional demands. To this end, we introduce \$OneMillion-Bench (\$OMB), a benchmark of...

Yang Liu, Jiaqi Li, Jun Bai et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching

Reasoning with large language models often benefits from generating multiple chains-of-thought, but existing aggregation strategies are typically trajectory-level (e.g., selecting the best trace or voting on the final answer), discarding useful intermediate work from partial or "nearly correct" attempts. We propose Sti...

Roy Miles, Aysim Toker, Andreea-Maria Oncescu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Obscuring Data Contamination Through Translation: Evidence from Arabic Corpora

Data contamination can invalidate benchmark evaluation when a model benefits from memorized evaluation content rather than genuine generalization. Yet contamination is difficult to audit when the exposed content differs in language from the evaluation benchmark. We study this failure mode by deliberately exposing four...

Chaymaa Abbas, Nour Shammaa, Mariette Awad · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Towards Scalable Meta-Learning of near-optimal Interpretable Models via Synthetic Model Generations

Decision trees are widely used in high-stakes fields like finance and healthcare due to their interpretability. This work introduces an efficient, scalable method for generating synthetic pre-training data to enable meta-learning of decision trees. Our approach samples near-optimal decision trees synthetically, creatin...

Kyaw Hpone Myint, Zhe Wu, Alexandre G. R. Day et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

AyurParam: A State-of-the-Art Bilingual Language Model for Ayurveda

Current large language models excel at broad, general-purpose tasks, but consistently underperform when exposed to highly specialized domains that require deep cultural, linguistic, and subject-matter expertise. In particular, traditional medical systems such as Ayurveda embody centuries of nuanced textual and clinical...

Sravan Gorugantu, Mohd Nauman, Vijay Devane et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.