Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Oct 2026

SFT-as-Context Mitigates Forgetting in Supervised Fine-Tuning

Supervised fine-tuning (SFT) equips large language models (LLMs) with specialized capabilities, but often comes at the cost of forgetting the general capabilities of their parent models (i.e., the pretrained models before fine-tuning). This trade-off is especially limiting for queries that require both specialized and...

Ke-Nan Tang, An-Dong Hua, Cheng-Xuan Qian et al. · 0 citations
#artificial intelligence Preprint Oct 2026

When Citations Mislead? A Claim-Level Benchmark for Legal Hallucination Detection

Large language models are increasingly used in legal research and drafting, but they can still produce claims that sound convincing without being supported by the cited source. We introduce PARCEL, a benchmark for checking whether a legal claim is supported by the underlying authority. Using recent New York State Court...

M. M. Demir, M. A. Canbaz · 1 citation
#artificial intelligence Preprint Oct 2026

Stochastic Teacher Intervention for Agentic On-Policy Distillation

STI-OPD, a stochastic teacher intervention framework for multi-turn agentic OPD, and an Importance-Weighted Reverse KL objective that corrects the token sampling mismatch between teacher-generated responses and the student policy to preserve the original OPD objective are introduced.

Jun-Nan Liu, Lin-Hao Luo, Zhijun Chen et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Real Long-Term Memory for AI: A 50-Million-Token Window That Is Faster and Cheaper Than Recompute

A large language model can only use the text that fits in its context window, and it recomputes its internal key-value (KV) state for a prompt every time the prompt is sent. We test a memory layer, the public package galahad-kv, that saves the KV state of each block of about 16,000 tokens to encrypted local NVMe disk a...

Sietse Schelpe · 0 citations
#artificial intelligence Preprint Oct 2026

Grammar Concept Annotation at Scale: Deployed Fine-Tuned Small Language Models Outperform Prompted Frontier Models

Corrective feedback is among the best-evidenced drivers of second-language acquisition, yet corrections delivered during lessons rarely accumulate into an actionable view of grammar mastery. Prompted frontier models can provide such a view from learner--tutor lesson transcripts, but they are costly at scale. We close t...

Marjan Celikik, A. Ramallo, Javier Morales · 0 citations
#artificial intelligence Preprint Oct 2026

NavGPT-3: Harnessing Context in a Hierarchical Navigation Runtime

NavGPT-3 is presented, a harness that connects the two models, with an OS-like runtime built above it: reasoning, acting, and monitoring run as threads with their own context, tools, and permissions, while the runtime schedules them and decides which thread controls the robot's motion, so that the robot can react to su...

Geng-Ze Zhou, Yicong Hong, Jiazhao Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Clarify, Then Focus: Statement Normalization for Conversation Analytics at Scale

A simple principle is proposed: clarify the text, then focus the reader, sharing this preparation across questions supports an inference pipeline built entirely from small models, making analytics over millions of conversations substantially less expensive.

Mikhail L. Arbuzov, Karan Dave, Evgeniya Dontsova et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Conversational Task Disambiguation over Tabular Data: Leakage-Aware Formulation, Benchmark Suite, and Training

Conversational task disambiguation over tabular data uses dialogue to resolve missing information about a user's intended task before producing a solution over tables or databases. Existing evaluation and training lack a leakage-aware foundation. Task success mixes the agent's disambiguation and solution-generation cap...

Nafiseh Ghoroghchian, Luis Scoccola, Tina Sedaghat et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

WorldBench: Evaluating LLMs on Three.js Voxel World Generation

Large language models can now write complete, interactive 3D worlds as code, but grading those worlds automatically is unreliable. Existing judges take one view of the output: a vision-language model scores a few rendered snapshots, or a language model reads the source. On worlds written by five frontier models we find...

Krish Bakshi · 0 citations
#artificial intelligence Preprint Oct 2026

OnTrack: Real-Time Monitoring and Intervention in LLM Agent Trajectories via Streaming Structure-Aware Optimal Transport

Agents are deployed in applications from trip planners and stock trading to IT incident triage. In most cases, LLM agents work autonomously with minimal rule-based safeguarding, leading to cost and safety issues from irreversible actions. Recent works resolve this either by using a safeguard agent to monitor behavior o...

Babak Barazandeh, C. Swanson, Chinmay Kulkarni et al. · 0 citations
#artificial intelligence Open access Oct 2026

Cited but Not Consulted: A Counterfactual Audit of Legal Chain-of-Thought Faithfulness

Large language models increasingly justify legal decisions by naming the statute or precedent behind a verdict, treated as evidence that the decision follows from it. We test this directly: holding case facts fixed, we substitute the named legal authority for an unrelated one and decode a model's evolving verdict from...

Saisab Sadhu, Shreeyans Arora, Pratinav Seth · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.