Skip to content

Category

natural language processing

9,261 papers

#natural language process... Preprint Open access Nov 2026

LibriSpeech-Real-QA: A Benchmark for Streaming Question Answering

Most speech large language models (SLMs) still process speech in an offline manner. They only start responding after they receive the complete speech segment. However, many real-world applications require streaming speech interaction, for which the audio continuously flows in and the machine is required to answer quest...

Zewen Zhan, Hui Lu, Xueyuan Chen et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

ArcRAG: Agentic Compositional Retrieval over Knowledge Graphs

Graph-based retrieval-augmented generation (GraphRAG) answers questions by retrieving over a knowledge graph built from a corpus. Yet retrieval strategies are designed around the structure their own construction pipeline produces, and whether they survive a change of construction is rarely tested. We study this cross-c...

Jyotin Goel, Abhinav Arun, Tejas Prakash Agarwal et al. · 0 citations
#natural language process... Preprint Open access Nov 2026

EvoGuard: Mitigating Degradation in Online Skill Evolution

Skills let language agents reuse experience across tasks as natural-language documents. Recent work evolves skills from interaction, but existing methods have limitations when skills evolve online. Prior methods update a skill offline from a batch of trajectories collected over many tasks. Some then adopt the new skill...

Yanli Wang, Zichen Bai, Tianyue Jiang et al. · 0 citations
#natural language process... Preprint Open access Nov 2026

Twists and Turns: A Graph-Based Benchmark and Framework for Long-Term Memory in Exploration Tasks

Long-term problem-solving processes, such as scientific research and software development, proceed along an evolving trial-and-error trajectory toward a central goal. We term these \textit{exploration tasks}, which require models to remember not only facts but also how solutions are tested against intermediate outcomes...

Chongyuan Dai, Yaling Shen, Zirui Song et al. · 0 citations
#natural language process... Preprint Open access Nov 2026

Ruby-OPD: Enhancing Pronunciation Controllability and Accuracy for Flow-Matching Text-to-Speech via On-Policy Distillation

Achieving both high pronunciation accuracy and fine-grained controllability remains a central challenge in Japanese text-to-speech (TTS), as Japanese is an unsegmented language mixing logographic Kanji and phonographic Kana with extensive polyphony. Traditional cascaded systems convert text into phoneme sequences via a...

Rui Hu, Xiaolong Lin, Zhenpeng Zhan · 0 citations
#natural language process... Preprint Open access Nov 2026

Interpretable Text Embeddings Based on Hierarchical Questions

QA-based text embeddings represent texts as vectors consisting of 1/0 answers to yes/no questions. Although these embeddings provide detailed information for interpretation and achieve high task performance, they often require humans to examine a large number of questions. Furthermore, the relationship between the numb...

Kohei Oda, Po-Min Chuang, Kiyoaki Shirai et al. · 0 citations
#natural language process... Preprint Open access Nov 2026

Where Should a KV-Cache Repair Budget Go? Distractor Structure and Contextual Compatibility in Non-Prefix Reuse

Non-prefix KV-cache reuse encodes retrieved chunks independently and concatenates their caches. To find where a small repair budget should be spent, we vary the chunks around the answer-bearing one (the target) across three 7B-8B models and four datasets of dialogue memory, open-domain QA and API documentation. Reuse l...

Yuxing Peng, Zhiqing Tang, Weijia Jia · 0 citations
#natural language process... Preprint Nov 2026

Presentation Sensitivity in Typed Decision Models for Subjective Text Evaluation

Typed decision models offer structured choices, scores, and probabilities for low-cost automated evaluation. We present a controlled audit of presentation sensitivity in Jev, Clef Flash, and Perplexity Decider across native choice and score interfaces. Across six datasets with 9,000 multiply annotated humor, helpfulnes...

Jatin Agrawal, R. Mamidi · 0 citations
#natural language process... Preprint Open access Nov 2026

Training-Free Character-Length Control in Summarization with Diffusion Language Models

Summarization with a fixed character length is important for tasks such as headline and article preview generation, where text must fit an exact space. Autoregressive language models (LMs) struggle with precise character-length control: training-based methods require task-specific fine-tuning, while zero-shot prompting...

Steffen Castle, Nils Feldhus, Christopher Ebert et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Mass Producing Training Data with Surprising Side Effects

Training data can have unexpected side effects on language model behavior outside the training domain: insecure code data can induce broad misalignment, and outdated bird names can induce a 19th-century persona. Understanding such generalization is hard because only dozens of isolated examples exist, each constructed b...

Yaowen Ye, Jacob Steinhardt, Sarah Schwettmann et al. · 0 citations
#machine learning Preprint Open access Nov 2026

Zuse: A Decision Model for European Languages

Decision models read a document and return a probability for each of a fixed set of options instead of generating text. Several appeared in 2026, but none has published results outside English. We describe Zuse, three decision models (4B, 9B and 27B) that train a low-rank adapter and a pointer head on frozen open-weigh...

Umair Mehmood Imam · 0 citations
#machine learning Preprint Open access Nov 2026

Loop Before You Leap: What Recurrent Depth Can and Cannot Buy in Data-Limited Pretraining

Multimodal models have often scored below text-only baselines in the BabyLM Challenge (Klerings et al., 2024; Takmaz et al., 2025). We test whether additional recurrent computation helps close this gap. Recurrence increases computation by reusing layers without adding parameters or training data. Using a single impleme...

Daichi Hotta, Yohei Kobashi, Takeshi Kojima et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.