Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Open access May 2025

Building Intelligent Agents with Neuro-Symbolic Concepts

A concept-centric framework for building agents that can learn continually and reason flexibly across multiple domains and offers several advantages, including data efficiency, compositional generalization, continual learning, and zero-shot transfer.

Jia-Yuan Mao, Joshua B. Tenenbaum, Jia-Jun Wu · 14 citations · ⚡1
#artificial intelligence Preprint Open access Sep 2026

Telescopic Language Models

One deployed language model must often serve many compute budgets, yet serving each budget still means a separate training or compression run per point. We train a Telescopic Language Model (TLM) to be that continuum: a nested-capacity Transformer supervised by stochastic prefix supervision with a full anchor. At every...

Zhilin Guo, Boqiao Zhang, Hakan Aktas et al. · 0 citations
#artificial intelligence Preprint Sep 2026

How to Loop MoE: Flatten the Experts, Untie the Attention

The ablations analyse why Foil works and turn the findings into design guidance for looped MoE: the returns of looping and of widening the expert layers amplify each other, routing confidence tracks healthy expert use better than load balance, and a sparse looped MoE should therefore use more experts per layer and more...

Shouren Wang, Chuan Ma, Mohsen Hariri et al. · 1 citation
#artificial intelligence Preprint Sep 2026

MS-GLA: Multi-Scale Gated Linear Attention for Addressing Representational Bottlenecks via Multi-Temporal Resolution

MS-GLA consistently achieves higher accuracy and lower perplexity than GLA at matched parameter counts, validating multi-temporal resolution decomposition as a principled and effective extension of Gated Linear Attention.

Prasoon Dev, Anirudh Sankar, Vasudeva Varma · 0 citations
#artificial intelligence Preprint Sep 2026

Twist, Don't Tilt: Trajectory-Exact Constrained Decoding for Masked Diffusion Models

This work introduces TWISTER, the first automaton-twisted Sequential Monte Carlo decoder for MDLMs, and proves that for regular language constraints, the Feynman-Kac correction is exactly computable, with the twists obtained efficiently using quantities pre-computed for step-exact sampling.

Aditya Thimmaiah, Lara Marinov, Jayanth Srinivasa et al. · 0 citations

SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents

This work introduces SEABench, a benchmark for studying endogenous misalignment arising from agent self-evolution, with 48 longitudinal task sequences that span multiple evolution surfaces, task domains, and harm types in a rich personal-assistant environment and shows that qualitatively different safety behaviors emer...

Saswat Das, Parvati Viswanathan, Daniel Donnelly et al. · 2 citations
#artificial intelligence Preprint Sep 2026

FactorEngram: Factorized N-gram Memory with Basis-Level Gating for Language Models

FactorEngram, a factorized n-gram memory with basis-level contextual gating that improves language modeling and downstream task performance and retrieves sparsity-regularized coefficients over a dictionary of basis vectors shared across patterns, so related patterns can reuse common components.

Bo-Wen Yang, Jing-Bo Zhou, Qing-Hong Miao et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Almieyar: A Culturally Grounded Benchmark for Multi-Dialect Arabic Speech Recognition

ALMIEYAR is introduced, a culturally grounded ASR benchmark covering 17 Arabic dialects across six families, built entirely from newly recorded speech unseen by existing models, including the first published benchmark for Ahwazi Arabic.

Omid Ghahroodi, Anas Madkoor, Dima Faris Alsaudi et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Token Scale: Chunk-Level Sparse Autoencoders for Reliable Semantic Feature Discovery

A family of chunk-level SAEs that encode mean-pooled activations over chunks, each a contiguous span of tokens: Mean-Chunk reconstructs the observed chunk, Cross-Chunk predicts an independently processed neighbor, and Joint-Chunk combines both targets are introduced.

Xu Wang, Yi-Fan Yang, Ting-Ting Yu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

CLIMB: A Clinical Multimorbidity Benchmark for Diagnosing Co-occurring Conditions through Multiturn Conversations

CLIMB is introduced, a benchmark in which a doctor model interviews a simulated patient to recover a ground truth set of co-occurring clinical conditions, and a theoretical reference model of single-hypothesis tracking is formalised with a theoretical reference model of single-hypothesis tracking.

Yusuf Kesmen, A. Mukherjee, Ye-Na Chang et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.