Skip to content

Category

natural language processing

9,261 papers

#machine learning Preprint Oct 2026

Language Models for Page-Level Layout Decisions in E-commerce Search

E-commerce search pages are critical touchpoints for millions of online shoppers. While traditional search engines return a ranked list of results, modern E-commerce search pages increasingly incorporate recommender system modules -- for example, secondary stacks that surface alternative product groupings at specific p...

Varun Joshi, Eva C. Song, Cheng-Xiang Zhai · 0 citations
#machine learning Preprint Oct 2026

Recurrent Self-Improvement: Dynamic Cross-Loop On-Policy Distillation for Looped Language Models

Looped Language Models (LoopLMs) offer a parameter efficient approach to scaling reasoning by reusing shared parameters across recurrent computation steps. Despite their promise, effective post-training of LoopLMs remains challenging. Existing approaches either provide reward based supervision that is sparse or costly...

Yi Wang, Rui Qian, Yu Li et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

What Transfers from Text to Vision? Capability Scaling Laws and Transfer Dynamics for VLMs

Choosing the right large language model (LLM) backbone is the most consequential decision when building a vision-language model (VLM), yet it remains fundamentally unprincipled: compute-based scaling laws fail to generalize across model families, and no framework exists for directly predicting VLM performance before tr...

Ziran Li, Qiang Wang, Zhengyu Chen et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Introducing Human-Centeredness in AI-Assisted Lexicography

This paper proposes a human-centered artificial intelligence (HCAI) framework for AI-assisted lexicography. While generative AI offers significant opportunities to enhance lexicographic work, it also raises concerns regarding the future role of lexicographers and the preservation of linguistic and cultural diversity. D...

Antonio San Martin, Catherine Trekker · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Pretrained self-supervised speech models can recognize unseen consonants

Modern pretrained self-supervised automatic speech recognition models are trained on large-scale audio data to encode speech into contextualized representations. However, their training data are heavily skewed toward high-resource languages with little data from low-resource languages, raising concerns about the potent...

Chihiro Taguchi, \'Eric Le Ferrand, Hirosi Nakagawa et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Learning to Attack and Defend: Adaptive Red Teaming of Language Models via GRPO

Language model safety must continually adapt to evolving attacks. Recent works have demonstrated that reinforcement learning can be used to train stronger attacker and defender models in tandem by applying PPO-style self-play and DPO-style online preference optimization. In this work, we explore the efficacy of GRPO in...

Blake Bullwinkel, Eugenia Kim, Amanda Minnich et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

LoRi: Low-Rank Distillation for Implicit Reasoning

Implicit chain-of-thought (iCoT) methods aim to internalize reasoning in large language models, but often underperform explicit CoT prompting. We empirically find that hidden-state reasoning trajectories exhibit low-rank structure. Motivated by this observation, we propose a low-rank distillation framework that transfe...

Ryan Solgi, Jiayi Tian, Zheng Zhang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems

Memory is essential for enabling large language models to support long-horizon reasoning, yet existing memory systems remain unreliable and difficult to debug. Tracing memory's dynamic evolution is crucial to understand how information is synthesized, propagated, or corrupted over time. In this work, we study the new p...

Xinle Deng, Ruobin Zhong, Hujin Peng et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

AI Appeals Processor: A Deep Learning Approach to Automated Classification of Citizen Appeals in Government Services

Government agencies must register, classify and route every citizen appeal within statutory time limits, and much of this work is still done by hand. We describe AI Appeals Processor, a classification and routing component deployed in a CPU-only government environment, and report what its evaluation and deployment taug...

Vladimir Beskorovainyi · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Imperative Interference: Social Register Shapes Instruction Topology in Large Language Models

System prompt instructions that cooperate in English compete in Spanish, with the same semantic content, but opposite interaction topology. We present instruction-level ablation experiments across four languages and four models showing that this topology inversion is mediated by social register: the imperative mood car...

Tony Mason · 0 citations
#artificial intelligence Preprint Open access Oct 2026

\$OneMillion-Bench: How Far are Language Agents from Human Experts?

As language models (LMs) evolve from chat assistants to long-horizon agents capable of multi-step reasoning and tool use, existing benchmarks remain largely confined to structured or exam-style tasks that fall short of real-world professional demands. To this end, we introduce \$OneMillion-Bench (\$OMB), a benchmark of...

Yang Liu, Jiaqi Li, Jun Bai et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching

Reasoning with large language models often benefits from generating multiple chains-of-thought, but existing aggregation strategies are typically trajectory-level (e.g., selecting the best trace or voting on the final answer), discarding useful intermediate work from partial or "nearly correct" attempts. We propose Sti...

Roy Miles, Aysim Toker, Andreea-Maria Oncescu et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.