Skip to content

Category

natural language processing

9,261 papers

#natural language process... Preprint Open access Oct 2026

Knowledge-Guided LLM for Intent-Driven Service Orchestration in Integrated Terrestrial and Non-Terrestrial 6G Networks

Natural-language service intents in integrated terrestrial and non-terrestrial (TN/NTN) 6G networks can be incomplete, ambiguous, or inconsistent, making unconstrained LLM generation challenging for reliable network-facing orchestration. This paper proposes a knowledge-guided LLM framework that combines grammar-constra...

Wajdi Hammami, Irfan Azam, Soumaya Cherkaoui · 0 citations
#machine learning Preprint Open access Oct 2026

Linear-Time Context Compression with State-Space Encoding

Transformer-based large language models (LLMs) impose substantial computation and memory costs as context sizes increase, motivating methods that compress a context into a shorter representation before inference. Existing soft-prompt compression methods typically use the same Transformer backbone as used in the target...

Marc Serra Ortega, Andrey Barsky, Carlos Boned Riera et al. · 0 citations
#machine learning Preprint Open access Oct 2026

OpenESM: Energy-Steered Models Are Scalable Foundation Learners

Energy-based models have shown promising properties for domain-specific tasks but remain challenging in modeling general-purpose scenarios. To bridge this gap, we design energy-steered models (ESMs) for foundational language modeling. ESMs integrate energy steering and token generation within a single architecture to l...

Yuan Pu, Yudong Lu, Ting Wang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Entity-Aware Evaluation of OCR Systems for Historical Document Transcription

Optical Character Recognition (OCR) is essential for digitizing historical archives, yet standard evaluation metrics such as Character Error Rate (CER) do not necessarily reflect whether meaningful information, such as names, dates, and identifiers, is preserved. In this work, we investigate entitylevel analysis of OCR...

Camilo Mari\~no (UDELAR, CB), Diego Belzarena (UDELAR et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

From Writing Advice to Manuscript Governance: A Constrained-Transformation Framework for Academic Revision

Academic revision presents a governance problem when legitimate writing objectives conflict. Writing-process and social-science research show that revision is recursive and that wording carries epistemic and disciplinary commitments. Those literatures identify important constraints but do not settle which objective sho...

Simon Rudkin · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Whispering Wisely: Smart Subset Selection for ASR Fine-Tuning

Automatic Speech Recognition (ASR) models such as OpenAIs Whisper have substantially improved speech recognition quality but remain expensive to fine-tune, especially when large amounts of transcribed audio are available. This makes it challenging for many practitioners to adapt these models to new languages or domains...

Roi Yozevitch, Or Haim Anidjar · 0 citations
#machine learning Preprint Open access Oct 2026

Under the Influence: Evaluating and Improving LLM Vigilance in Agentic Tasks

Large Language Models (LLMs) are becoming increasingly autonomous assistants, capable of accomplishing series of complex tasks by interacting with open world domains such as software databases and the internet. This presents great opportunity but also great risk: open domains routinely present opportunities for autonom...

Sasha Robinson, Katherine M. Collins, Ilia Sucholutsky et al. · 0 citations
#machine learning Preprint Open access Oct 2026

NodeSyn: Socially Aligned Synthetic Data for AI Evaluation

Recent advancements in generative AI facilitate large-scale synthetic data generation for model evaluation. However, without targeted approaches, these datasets often lack the sociotechnical nuance required for sensitive domains. We introduce NodeSyn, a methodology that pairs a fine-tuned taxonomy generator (TaG) with...

Qazi Mamunur Rashid, Xuan Yang, Zhengzhe Yang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Measure Before You Train: Typed Decision Models vs. a Classical Baseline vs. a Generative LLM for Routing a Personal Multilingual Inbox

Personal email agents decide, for every message, what it is, whether it is urgent, whether to draft a reply, create a task, or ignore it. Their error rate is rarely measured: the stored labels were written by the system itself. We present Foyer, a self-hosted personal inbox agent in daily use, and a measurement protoco...

Federico Lucca · 0 citations
#machine learning Preprint Oct 2026

Adaptive Frequency Threshold Byte Pair Encoding for Mixed Natural Language and Structured Symbolic Corpora

Modern language models rely on subwording tokenization to define the discrete units of input processing, typically using methods like Byte Pair Encoding (BPE) that treat whitespace as a fixed semantic boundary. This design is inherently limited, as many meaningful concepts---including multiword expressions and the stru...

Pietro Di Nicco, Lucio La Cava, Andrea Tagarelli · 0 citations
#machine learning Preprint Open access Oct 2026

Acoustic and Lexical Signals for Native Language Identification of Language Learners

Spoken native language (L1) identification for second language learners has traditionally relied on acoustic attributes of speech. Comparatively little attention has been paid to analysing speech transcripts for L1 traces. In this paper, we present a study of L1 identification using both speech and corresponding transc...

Ahmet Yavuz Uluslu, Mengjie Qian, Kate Knill et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Do Halting Heads Really Save Compute in Looped Language Models?

Looped language models run each token through the same layers several times, and each run is one iteration. To save compute, an extra layer, the halting head, gives after each iteration the probability that the token stops there, so that easy tokens can stop early. Pretraining models from scratch, up to 1.3B parameters...

Tsung-Han Wu, Minsuk Heo, Kenny Tan · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.