Skip to content

Category

natural language processing

9,261 papers

#artificial intelligence Conference Open access Oct 2026

A Scaled-Up Empirical Study of Syntactic Language Models

Syntactic language models (SLMs) that generate sentences along with their syntactic tree structures have shown promise in both syntactic generalization and downstream tasks. Prior studies, however, have mostly evaluated smaller models trained on less pretraining data and tested on narrower task suites. In addition, the...

Peng-Cheng Wang, Zhe-Xu Zhang, Chao Lou et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Audit Before You Distill: A Controlled Workflow for Reasoning Transfer into Compact Medical Language Models

Teacher rationales can help a smaller model answer health professions questions, but they can also reinforce errors. We examined when they help and how this evidence can guide training using Brazilian Portuguese questions from medical and multiprofessional residency examinations. First, we measured how a teacher ration...

Tiago Martinelli, Jo\~ao Paulo Papa, Adriano Jos\'e Pereira · 0 citations
#artificial intelligence Preprint Open access Oct 2026

SuPER-Mamba: Surprisal Prioritization for Extended-Context Routing in Mamba

State space models provide efficient linear-complexity processing for long sequences, but their performance frequently degrades as context length grows. We propose SuPER-Mamba, a training-free framework that uses Surprisal as a model-intrinsic signal for long-range state routing in pretrained Mamba models. SuPER-Mamba...

Zhetong Zhang, Gayan K Kulatilleke · 0 citations
#artificial intelligence Preprint Oct 2026

MixLID: Token-Level Language Identification in Mixed-Language Text

Processing multilingual text requires both identifying a broad range of languages and distinguishing the language of each token in inputs containing multiple languages. We introduce MixLID, a token-level language identification model supporting 111 language-script combinations. MixLID follows a two-stage training proce...

Seongtae Hong, Youngjoon Jang, Seungyoon Lee et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

PatTransBench: an ipc-stratified, multi-dimensional benchmark for patent machine translation evaluation

We present PatTransBench, a 12,000-item Chinese-English/Japanese/Korean patent machine translation (PatMT) benchmark with a four-dimensional evaluation protocol. The benchmark comprises 6,000 short-text (sentence/claim) and 6,000 long-text (paragraph) pairs, evenly split across three language pairs and both translation...

Xiaowei Su, Xusen Cheng · 0 citations
#artificial intelligence Preprint Oct 2026

PATMT2: Two-stage domain adaptation for multilingual patent translation

We present PatMT2 (Patent Machine Translation, v2), a two-stage LoRA pipeline that adapts the Hy-MT2-7B dedicated translation model to four-language (Chinese/English/Japanese/Korean) patent translation. On six translation directions, the Stage-2 checkpoint reaches a macro-average BLEU of 43.39 (BF16) to 43.57 (AWQ INT4...

Xiao-Wei Su, Xu-Sen Cheng · 0 citations
#artificial intelligence Preprint Oct 2026

VisExMEM: Visual Evidence-Based Explainable Multimodal Evaluation Metric

Current image-text evaluation often relies on a global score, which gives limited insight into which semantic details are supported by the image. Explainable metrics provide rationales, but the visual evidence supporting those rationales can still be difficult to verify. We introduce VisExMEM, a reference-free evaluato...

Subhadeep Roy, Christoph Leiter, S. Eger · 0 citations
#artificial intelligence Preprint Open access Oct 2026

ARMED: Adaptive Retrieval-Augmented Medication Recommendation

Medication recommendation requires jointly considering diagnoses, comorbidities, longitudinal patient history, and treatment interactions. Although recent retrieval-augmented generation approaches using language models have shown promise for clinical recommendation, most existing systems rely on fixed retrieval pipelin...

Kyungkeon Chung, Se Un Park, Hyejin Lee et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Avoiding What Your Teacher Already Knows: Entity Familiarity for Deep-Search Distillation

Deep-search agents are commonly trained by distilling tool-use trajectories from stronger teacher models. However, structurally complex questions may remain relatively easy for teachers familiar with key entities in the underlying entity graph, resulting in lower search demand and weaker supervision. We refer to this t...

Yifei Liu, Zhixiang Liang, Wentao Tan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Omni-Modal LLMs Know More Than They Say

Omni-modal large language models (Omni-LLMs) extend LLMs to process heterogeneous modalities (e.g., vision, audio, and IMU signals) alongside language, enabling a broader range of multimodal tasks. Yet we find that these models often fail to express information from non-textual modalities even when they perceive it cor...

Na-Min An, Taekyung Kim, Jaemyung Yu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Query Your Way Out: Benchmarking Multi-Turn Knowledge Reasoning through Generalized Puzzle Solving

Puzzles offer a natural testbed for Large Language Models (LLMs) reasoning because they pose verifiable goals under partial information and require multi-step decisions to reach a solution. However, existing puzzle benchmarks typically focus on narrow environments with rigid mechanics and tightly constrained solution t...

Xin Cheng, Jun-Ming Yang, Ning Xu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

PID-Gated Continual Prompt Adaptation Under Noisy Feedback

Deploying LLM agents in non-stationary environments requires continually revising their instructions as the task drifts, yet rewriting after every reported mistake can turn noisy feedback into persistent errors. This raises an often-overlooked scheduling question in prompt adaptation: when should feedback trigger a las...

Zhentao Xu · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.