Skip to content

Category

natural language processing

9,261 papers

#artificial intelligence Preprint Open access Oct 2026

WorldBench: Evaluating LLMs on Three.js Voxel World Generation

Large language models can now write complete, interactive 3D worlds as code, but grading those worlds automatically is unreliable. Existing judges take one view of the output: a vision-language model scores a few rendered snapshots, or a language model reads the source. On worlds written by five frontier models we find...

Krish Bakshi · 0 citations
#artificial intelligence Preprint Oct 2026

OnTrack: Real-Time Monitoring and Intervention in LLM Agent Trajectories via Streaming Structure-Aware Optimal Transport

Agents are deployed in applications from trip planners and stock trading to IT incident triage. In most cases, LLM agents work autonomously with minimal rule-based safeguarding, leading to cost and safety issues from irreversible actions. Recent works resolve this either by using a safeguard agent to monitor behavior o...

Babak Barazandeh, C. Swanson, Chinmay Kulkarni et al. · 0 citations
#artificial intelligence Open access Oct 2026

Cited but Not Consulted: A Counterfactual Audit of Legal Chain-of-Thought Faithfulness

Large language models increasingly justify legal decisions by naming the statute or precedent behind a verdict, treated as evidence that the decision follows from it. We test this directly: holding case facts fixed, we substitute the named legal authority for an unrelated one and decode a model's evolving verdict from...

Saisab Sadhu, Shreeyans Arora, Pratinav Seth · 0 citations
#artificial intelligence Preprint Oct 2026

Accurate but Not Humble: Evaluating Epistemic Humility in LLM Agents under Knowledge Conflict

When retrieved evidence contradicts an agent's prior beliefs, does it revise its answer, acknowledge uncertainty, or persist with an incorrect conclusion? Existing evaluations of agentic systems focus primarily on task success, offering limited insight into how agents handle such conflicts. We propose to evaluate agent...

Kaiser Sun, Bernal Jiménez Gutiérrez, Hong-Jun Liu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Overcoming Prior Barriers: Supervised Fine-Tuning under Long-Tail Distribution

Supervised fine-tuning (SFT) adapts pretrained large language models (LLMs) to downstream tasks, but the required concepts can receive substantially different levels of pretrained support. Frequent concepts are more likely to be well learned, whereas rare concepts may remain weakly represented. We introduce a novel not...

Haohui Wang, Jiahao Xu, Wangzhi Zhan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Can AI Agents Learn Their Way to the Top? Evaluating Heuristic Learning in a Long-Running Game Agent Competition

Adversarial games have driven advances from heuristic search to reinforcement learning, yet learning and adapting strategies from limited samples remain challenging. AI agents offer an alternative by turning game experience into revisions of executable policies. Building on heuristic learning (HL), we formalize Adversa...

Kai-Sen Yang, Qing-Le Liu, Ke-Jin Wang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Verdict Without the Rule: Diagnosing and Auditing Regulatory Rule Sensitivity in LLM Compliance Systems

Large language model compliance systems are deployed on the assumption that a verdict depends on the regulatory rule it is given. We test this directly across five models and 20 regulatory and platform-policy domains: delete, swap, or negate the governing rule while holding the case fixed, and check whether the verdict...

Saisab Sadhu, Aadit Sengupta, Vinay Kumar Sankarapu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimation

Large language model (LLM)-based agents have demonstrated strong capabilities on complex tasks. They typically perform reasoning before each action throughout an interaction trajectory. However, reasoning may not be necessary at every turn, as reasoning produced earlier can continue to support subsequent actions. A key...

Yiruo Cheng, Shen Huang, Xiaoshuai Song et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

InterviewPlayground: A Simulation Environment for Evaluating AI Interviewers

Increasingly, AI interviewers are being developed to elicit open-ended responses in applications like market research, public polling, preference elicitation, and social science research. However, evaluating AI interviewers is challenging because they function in extended, multi-turn interactions where they must adapt...

Jonathan Ivey, Aimee Liang, Arthur Y. S. Wang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

MindFlow: Mind Supernet Powered Thinking Flows for Research Idea Innovation

Research idea innovation is a fundamental engine of scientific progress, yet it remains difficult to generate and evaluate in a scalable and controllable way. This challenge lies in its inherently open-ended and multi-objective nature, where ideas should balance novelty, plausibility and feasibility. While recent LLM-b...

Mengdi Liu, Wenjue Chen, Wenyue Chen et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Memento 3: Model-Based Recursive Self-Improvement through Reflective Rulebooks

Learning to act in unfamiliar environments requires agents to infer how the world works and revise that understanding as new evidence arrives. Yet limited observations can support multiple world models that explain past interactions but predict different outcomes in unseen states. We introduce Memento 3, building on th...

Hao-Yu Zhao, Zhengxu Yu, Zhi-Yuan He et al. · 3 citations
#artificial intelligence Preprint Oct 2026

RouterInterp: Understanding Superposed Specialisation in Mixture of Experts Routing

Sparse Mixture of Experts (MoE) models scale more efficiently than dense models by routing tokens to modular expert networks that are only active for processing a fraction of tokens. A leading hypothesis for the performance of MoE models is that each expert specialises in a single, coherent domain. However, interpretab...

I. Lasy, Nora Yinuo Cai, K. Ayonrinde · 1 citation

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.