Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Open access Sep 2026

What Is The Political Content in LLMs' Pre- and Post-Training Data?

Large language models (LLMs) reflect politically-slanted opinions in their generated text. Even though it is widely assumed that model behavior stem from training data, there has been no study quantifying the extent to which political content is part of the training data. To bridge this gap, we aim to directly estimate...

Tanise Ceron, Dmitry Nikolaev, Dominik Stammbach et al. · 0 citations

From Outliers to Topics in Language Models: Anticipating Trends in News Corpora

This paper examines how outliers, often dismissed as noise in topic modeling, can act as weak signals of emerging topics in dynamic news corpora. Using vector embeddings from state-of-the-art language models and a cumulative clustering approach, we track their evolution over time in French and English news datasets foc...

Evangelia Zve, Benjamin Icard, Alice Breton et al. · 2 citations
#artificial intelligence Preprint Open access Sep 2026

Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey

The rapid advancement of large language models (LLMs) has intensified the need for effective mechanisms to transform continuous multimodal data into discrete representations suitable for language-based processing. Discrete tokenization, with vector quantization (VQ) as a central approach, offers both computational effi...

Jindong Li, Yali Fu, Jiahong Liu et al. · 0 citations
#artificial intelligence Preprint Jun 2025

Calibrating Lightweight Sparse Autoencoder Feature Steering

This work introduces ContrastSteer, a complementary heuristic that measures whether post-steering activations emphasize weakly aligned features, thus indicating off-target or nonsensical outputs, and introduces contamination, a complementary heuristic that distinguishes successful steering, under-steering, and over-ste...

Ananya Joshi, C. Cintas, Skyler Speakman · 1 citation
#artificial intelligence Preprint Open access Sep 2026

Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning

Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in understanding common visual elements, largely due to their large-scale datasets and advanced training strategies. However, their effectiveness in medical applications remains limited due to the inherent discrepancies between data and...

Weiwen Xu, Hou Pong Chan, Long Li et al. · 0 citations
#natural language process... Conference Apr 2025

Efficient and Adaptive Simultaneous Speech Translation with Fully Unidirectional Architecture

Experiments on both in-domain (MuST-C) and out-of-domain (Europarl-ST) En-De and En-Es datasets demonstrate that EASiST offers superior latency-quality trade-offs compared to several strong baselines.

Biao Fu, Donglei Yu, Min-Peng Liao et al. · 16 citations · ⚡1
#natural language process... Conference Apr 2025

AskQE: Question Answering as Automatic Evaluation for Machine Translation

This work introduces AskQE, a question generation and answering framework designed to detect critical MT errors and provide actionable feedback, helping users decide whether to accept or reject MT outputs even without the knowledge of the target language.

Dayeon Ki, Kevin Duh, Marine Carpuat · 9 citations
#computer vision Preprint Open access Sep 2026

3D-MoE: Towards Spatial Intelligence with Mixture-of-Experts for 3D Reasoning and Action Generation

Spatial intelligence, encompassing 3D perception and reasoning, is the essential next frontier of AI. Scaling current 3D vision-language models (VLMs) that rely on dense Transformers for spatial tasks incurs prohibitive computational costs. In this paper, we introduce 3D-MoE, a 3D VLM leveraging an efficient mixture-of...

Yueen Ma, Zenglin Xu, Irwin King · 0 citations
#natural language process... Preprint Open access Sep 2026

Compound-QA: A Benchmark for Evaluating LLMs on Compound Questions

Large language models (LLMs) demonstrate remarkable performance across various tasks, prompting researchers to develop diverse evaluation benchmarks. However, most benchmarks typically measure the ability of LLMs to respond to individual questions, neglecting the complex interactions in real-world applications. We intr...

Yutao Hou, Yajing Luo, Zhiwen Ruan et al. · 0 citations
#artificial intelligence Preprint Nov 2024

A Course Intelligence Platform for Higher Education: Lessons from AI-Assisted Course Evaluation

A course intelligence platform deployed across more than 100 universities and serving over 10,000 instructors in China is presented, suggesting that AI-assisted evaluation requires not only capable models but also structured domain knowledge and transparent criteria.

Bo Yuan, Jiazi Hu, Haimei Zhao · 6 citations
#natural language process... Preprint Open access Sep 2026

SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machine

Large Language Models with chain-of-thought prompting, such as OpenAI-o1, have shown impressive capabilities in natural language inference tasks. However, Multi-hop Question Answering (MHQA) remains challenging for many existing models due to issues like hallucination, error propagation, and limited context length. To...

Xiaochen Wang, Liang Chen, Reza Haf Zhe Yang et al. · 0 citations

Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledge

A novel defense method called Eraser is proposed, which mainly includes three goals: unlearning harmful knowledge, retaining general knowledge, and maintaining safety alignment, which can significantly reduce the jailbreaking success rate for various attacks without compromising the general capabilities of the model.

Wei-Kai Lu, Zi-Qian Zeng, Jian-Wei Wang et al. · 61 citations · ⚡11

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.