Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Sep 2026

Order-Invariant Answers, Order-Sensitive Representations in Mathematical Reasoning

Reordering a set of mathematical rules without changing its meaning should preserve the correct answer, but must a model's internal representations stay invariant too? We investigate this question using synthetic multi-step function-composition problems, each presented under multiple rule orderings with the same correc...

Zhi-Long Tao · 0 citations
#machine learning Preprint Sep 2026

Log-Depth Recurrent Language Modeling

This work extends balanced-tree recursive operators from sequence encoding to autoregressive prediction, enabling all prefix representations to be computed with logarithmic depth and linear runtime.

Yi-Qing Wang, Nuri Cingillioglu, C. Pert · 0 citations
#machine learning Preprint Open access Sep 2026

Exact Quantile Balancing and Load-Error Injection for Mixture-of-Experts

Mixture-of-Experts (MoE) training requires global load balance to prevent expert under-utilization and local balance for efficient expert-parallel execution. Existing distributed Quantile Balancing (QB) uses shard-dependent or approximate global quantiles, while token-independent expert biases cannot ensure microbatch-...

Pit Neitemeier, Jiaze Li, Alessio Serra et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

FLEET: From Logits Entropy to Enhanced Trajectories in Text Generation

Solutions based on large language models (LLMs) often rely on temperature sampling to improve accuracy and stability by aggregating multiple samples from the completion distribution. However, this memoryless approach is inherently suboptimal: because it lacks awareness of prior generations and their evaluations, it pro...

Oleksii Streltsov, Oleksandra Vitko · 0 citations

ProCredit: From Outcome Rewards to Progress Credit in Agentic Reinforcement Learning

Long-horizon agentic tasks require an agent to modify an environment through a sequence of tool calls, with success determined by the final state. The standard recipe assigns a single outcome reward at the end and compares trajectories sampled for the same task. As a result, a group with no successful trajectory yields...

Ming Ma, Yi Zhu, Yi-Ran Zhong et al. · 2 citations · ⚡1
#artificial intelligence Preprint Sep 2026

The Linear Representation Hypothesis Needs a Group Action

It is argued that the Linear Representation Hypothesis is not one hypothesis but a family of claims distinguished by representation equivalence, and this framework clarifies how assumptions can change across metrics, reading points, and analysis stages, and is used to audit common representation quantities and recent i...

Louie Hong Yao, Yu-Hao Li, Sheng-Chao Liu · 0 citations

ChipMEM: Verification-Grounded Memory for EDA Agents

ChipMEM, a verification-grounded memory layer for EDA agents, is introduced, a verification-grounded memory layer for EDA agents that combines cross-task procedural memory with within-trajectory statistical guidance.

Abdulrahman Alrabah, Joshua Mabry, Dilek Z. Hakkani-Tür et al. · 0 citations

CONCAT: Consensus- and Confidence-Driven Ad Hoc Teaming for Efficient LLM-Based Multi-Agent Systems

This paper proposes CONCAT, a training-free multi-agent collaboration framework based on CONsensus and Confidence-driven Ad hoc Teaming to efficiently organize agent interactions and achieves up to 2.02x higher efficiency than LLM-Debate and outperforms training-aware methods such as AgentDropout.

Ziyang Ma, Dingyi Zhang, Si-Chu Liang et al. · 0 citations
#natural language process... Open access Sep 2024

Therapy as an NLP Task: Comparing LLMs and Human Peers Behaviors in CBT Sessions

Large language models (LLMs) are increasingly being used as ad hoc therapists. While prior research has found that LLMs outperform human counselors in generating single-turn empathetic responses, fewer studies have compared their behaviors across multi-turn sessions. In this study, we compare the session-level behavior...

Zainab Iftikhar, S. Ransom, A. Xiao et al. · 0 citations
#natural language process... Preprint Aug 2026

ROBE: Reversed-Order-Biased-Experts for Extracting Extreme Long-tail Events from Historical Texts

This paper proposes methods to extract over 50 types of events from a Dutch historical corpus spanning the 17th and 18th centuries, and proposes creating expert classifiers for subgroups of the events present in the training data based on similar frequency in the training data or on semantic relatedness.

S. Verkijk, Piek Vossen · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.