Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Open access Oct 2026

Paradee: Distilling Kokoro-82M into an 8M-Parameter Single-Voice Text-to-Speech Model

We distill Kokoro-82M, a widely used open text-to-speech model with 54 voices, into Paradee, an 8.07M-parameter model that speaks one of them. Paradee keeps Kokoro's architecture with much narrower layers, and each of its two halves is trained separately against the frozen teacher. It has 10x fewer parameters and needs...

Sahil Mahendrakar · 0 citations
#artificial intelligence Preprint Oct 2026

IdeaLens: Detecting AI Ideas in Long-form Writing

While modern AI detectors identify who wrote the words, emerging policies on AI use increasingly hinge on a different question: who came up with the ideas? We introduce IdeaLens, a detector that identifies whether a document's ideas came from a human or AI (idea provenance), regardless of who wrote its words. To focus...

Rishanth Rajendhran, Minjoon Choi, Jenna Russell et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Balancing Memory Pathways: Analyzing and Improving Memory Utilization in Hybrid LMs

Recurrent-attention hybrid language models (LMs), which interleave attention and recurrent layers, are increasingly used to combine the efficiency of the recurrent layers with the strong performance of attention layers. Prior work suggests that attention and recurrent layers offer complementary pathways to use past inf...

Hyunji Lee, Joykirat Singh, Zaid Khan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Frozen Factor or Spectral Band? Disentangling Two Choices in Low-Rank LoRA

Spectral variants of low-rank adaptation (LoRA) choose both a subspace and which factor to freeze. We separate these choices by freezing the input factor A or output factor B on the top or bottom singular directions of pretrained weights, with learning rates selected separately. At rank 2, the same-band advantage of fr...

Adnan Slimane Ali, Ayoub Belfatmi, David Ngwe Pouth · 0 citations
#artificial intelligence Preprint Oct 2026

Word-Level Text Unmixing via Evidence-Preserving Ownership Routing with Language Models

Text from multiple sources can become interleaved into a single sequence when attribution metadata is lost, such as overlapping speech transcripts, document reading flows, or concurrent agent streams. We formalize this challenge as Word-Level Text Unmixing: given an interleaved lexical stream and source count K, recove...

Jin-Ling He, Si-Yang Jiang, Li-Xing He et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistants

AI voice assistants often use Automatic Speech Recognition (ASR) with LLM-based reasoning, yet existing systems struggle with regional British accents, including Scottish, Irish, and Welsh accents, since most ASR models are trained predominantly on American English voice data. Consequently, errors can carry through to...

Aadam Haq, Oggi Rudovic, Malcolm Chadwick et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Anatomy of LLM Sycophancy: What a Flip Rate Hides

A model under pushback can correct itself, capitulate, or hold, and one flip rate counts a correction and a capitulation alike. Using SycoLens, a modular replay protocol, we test how user pressure and evaluation settings shape measured flip rates. Each measurement is one stateless replay of an item, a committed answer,...

Haonan Huang · 0 citations
#artificial intelligence Preprint Oct 2026

The Assistance Dilemma: Learning to Teach via Multi-Turn Reinforcement Learning

Large language models (LLMs) trained to answer questions are natively poor at teaching. Reinforcement Learning (RL) against a simulated student is a promising approach to improve their pedagogy, but existing RL-trained tutors reward the student's success on the tutored problem with the tutor's words still in context. T...

Jakub Macina, Manu Kapur, Mrinmaya Sachan · 0 citations
#artificial intelligence Preprint Oct 2026

Better Call Reward: Reward Hacking as Strategic Abstention in Legal Reasoning Models

What happens when a legal AI model learns to look like a lawyer instead of reasoning like one? We fine tune Qwen3-8B with Group Relative Policy Optimisation (GRPO) against a proxy built from three surface features: citation count, legalese density, and response length. The model does not learn to reason more effectivel...

Subramanyam Sahoo, Justin C. Shenk · 0 citations
#artificial intelligence Preprint Oct 2026

SpatialChain: A Benchmark for Auditing Spatial Reasoning Faithfulness in VLMs

Thinking-enabled vision-language models (VLMs) report ever-higher accuracy on spatial benchmarks, yet final-answer scores cannot reveal whether a correct prediction reflects faithful spatial reasoning or a linguistic shortcut. We introduce SpatialChain, a dataset of 28,350 training and 899 test examples pairing spatial...

R. Sousa, Vinícius Paulo Lopes de Oliveira, E. A. M. de Oliveira et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Steering by Influence: Curvature Aware Data Weighting for Activation Steering

Inference-time steering offers cheap, fine-grained control over a language model's outputs by estimating a concept's representation in activation space and shifting activations towards it. Existing methods build these representations from activation averages over contrastive datasets. These averages incorporate unrelat...

James A. E. Dixon, Stephen J. Roberts, Francesco Quinzan · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.