Skip to content

Category

natural language processing

9,261 papers

#natural language process... Preprint Open access Oct 2026

Measuring AI "Slop" in Text

AI "slop" is an increasingly popular term used to describe low-quality AI-generated text, but there is currently no agreed upon definition of this term nor a means to measure its occurrence. In this work, we develop a taxonomy of "slop" through interviews with experts in NLP, writing, and philosophy, and propose a set...

Chantal Shaib, Tuhin Chakrabarty, Diego Garcia-Olano et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Cross-Layer Attention Probing for Fine-Grained Hallucination Detection

With the large-scale adoption of Large Language Models (LLMs) in various applications, there is a growing reliability concern due to their tendency to generate inaccurate text, i.e. hallucinations. In this work, we propose Cross-Layer Attention Probing (CLAP), a novel activation probing technique for hallucination dete...

Malavika Suresh, Rahaf Aljundi, Ikechukwu Nkisi-Orji et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Speculating LLMs' Chinese Training Data Pollution from Their Tokens

Tokens are basic elements in the datasets for LLM training. It is well-known that many tokens representing Chinese phrases in the vocabulary of GPT (4o/4o-mini/o1/o3/4.5/4.1/o4-mini) are indicating contents like pornography or online gambling. Based on this observation, our goal is to locate Polluted Chinese (PoC) toke...

Qingjie Zhang, Di Wang, Haoting Qian et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Automatic Tensor-level Execution of Abstract Interpreters for Neural Networks

Developing new abstract interpretation-based DNN certifiers is difficult because their mathematical design is expressed at the neuron level, while implementations must operate at the tensor level. Existing libraries such as auto_LiRPA, IVAN, and ERAN support fixed sets of certifiers; extending them requires expertise i...

Avaljot Singh, Yasmin Chandini Sarita, Aditya Mishra et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Safety Alignment via Constrained Knowledge Unlearning

Despite significant progress in safety alignment, large language models (LLMs) remain susceptible to jailbreak attacks. Existing defense mechanisms have not fully deleted harmful knowledge in LLMs, which allows such attacks to bypass safeguards and produce harmful outputs. To address this challenge, we propose a novel...

Zesheng Shi, Yucheng Zhou, Jing Li · 0 citations
#natural language process... Preprint Open access Oct 2026

Atomic Consistency Preference Optimization for Long-Form Question Answering

Large Language Models (LLMs) often produce factoid hallucinations - plausible yet incorrect answers. A common mitigation strategy is model alignment, which improves factual accuracy by training on curated (factual, non-factual) pairs. However, this approach often relies on a stronger model (e.g., GPT-4) or an external...

Jingfeng Chen, Raghuveer Thirukovalluru, Junlin Wang et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Optimizing Singular Spectrum for Large Language Model Compression

Large language models (LLMs) have demonstrated remarkable capabilities, yet prohibitive parameter complexity often hinders their deployment. Existing singular value decomposition (SVD) based compression methods simply deem singular values as importance scores of decomposed components. However, this importance ordered b...

Dengjie Li, Tiancheng Shen, Yao Zhou et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Learning to Retrieve and Reason on Knowledge Graph through Active Self-Reflection

Extensive research has investigated the integration of large language models (LLMs) with knowledge graphs to enhance the reasoning process. However, understanding how models perform reasoning utilizing structured graph knowledge remains underexplored. Most existing approaches rely on LLMs or retrievers to make binary j...

Han Zhang, Langshi Zhou, Hanfang Yang · 0 citations

VietMed: A Dataset and Benchmark for Automatic Speech Recognition of Vietnamese in the Medical Domain

VietMed is a Vietnamese speech recognition dataset in the medical domain comprising 16h of labeled medical speech, 1000h of unlabeled medical speech and 1200h of unlabeled general-domain speech, and the first public large-scale pre-trained models for Vietnamese ASR, w2v2-Viet and XLSR-53-Viet are released along with th...

Khai Le-Duc · 20 citations
#artificial intelligence Preprint Open access Oct 2026

AI-Driven Reproducibility and Analytical Robustness in Scientific Discovery

Reproducible and analytically robust research findings are essential to scientific progress, but evaluating these properties typically requires costly manual effort. We investigate whether LLM agents can help automate reproduction and robustness analysis, using a medical case study grounded in the Surveillance, Epidemi...

Shicheng Liu, Krista Opsahl-Ong, Andrew Drozdov et al. · 0 citations
#natural language process... Preprint Oct 2026

VocalGrad: Evaluating Acoustic Perception in Audio Language Models

Recent large audio language models (LALMs) have extended their capabilities beyond lexical speech understanding to tasks requiring paralinguistic and non-linguistic audio understanding, such as emotion recognition. However, these models still struggle to reliably utilize acoustic information, particularly when it co-oc...

Koki Ryu, Hitomi Yanaka · 0 citations
#natural language process... Preprint Open access Oct 2026

RedDarwin: Evolving Jailbreak Skills against Frontier LLMs

Red teaming must continually adapt as frontier LLM safeguards evolve, yet existing approaches largely search for adversarial prompts or optimize within fixed attack procedures. We observe that even when an attack becomes ineffective, its underlying mechanisms can remain useful and can be revised or recombined to constr...

Zhouyuan Ma, Yutao Wu, Hanxun Huang et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.