Skip to content

Category

natural language processing

9,261 papers

#artificial intelligence Open access Apr 2025

Beyond public access in LLM pre-training data

The results suggest that GPT-4o, OpenAI’s more recent and capable model in the authors' sample, exhibits patterns consistent with recognition of non-public books, and support disclosure requirements for pre-training data provenance and formal licensing markets for training content.

Sruly Rosenblat, Tim O'Reilly, Ilan Strauss · 0 citations
#artificial intelligence Review Jul 2026

Real-World Evaluation of an AI Agent Drafting Translational Impact Summaries

A human-in-the-loop AI agent that assembles a dossier of sourced evidence for each scholar and drafts one-sentence Translational Science Benefits Model (TSBM) impact summaries for staff review and found the agent's recall close to human search.

Mohammad Arvan, Amber E. Osterholt, Baile Rue et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

The Model as One Rater Among Several: Measuring Political Positions in Data-Sparse Regions with a Language-Model Panel

Most instruments for measuring political positions, such as manifesto coding, expert surveys and text-scaling models, were built and validated on Western party systems, and they break down worst where many consequential actors never publish a manifesto, never contest a competitive election, or commit one position to a...

Tarek Gara · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Reinforcement learning to improve large language model-based automated code compliance systems

Large language model (LLM)-based approaches for automated code compliance (ACC) of building regulations are prone to generating incorrect and hallucinated computer-processable rules. This paper introduces P4IR, a two-stage framework that uses supervised fine-tuning (SFT) to instill domain knowledge in an LLM, followed...

Jack Wei Lun Shi, Minghao Dang, Wawan Solihin et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

EHRNote-ChatQA: A Benchmark for Evidence-Grounded Multi-Turn Clinical Question Answering over Longitudinal Discharge Summaries

Discharge summaries are crucial clinical documents containing the context of a patient's overall hospital stay, and are routinely reviewed by medical experts for patient readmission, ongoing care, and diagnostic decision-making. When reviewing them, medical experts often must iteratively synthesize information across m...

Jiyoun Kim, Muhan Yeo, Eunhye Jang et al. · 0 citations

Evaluating the Robustness of Proof Autoformalization in Lean 4

It is argued that a robust proof autoformalizer must remain faithful even for informal proofs that diverge from these idealized ones, and the first study on the robustness of proof autoformalization models is presented.

Zheng-Tao Gui, Sheng-Yuan Yang, Zhouxing Shi · 2 citations
#artificial intelligence Preprint Open access Oct 2026

Fine-tuning Multi-modal LLMs with ART: Art-based Reinforcement Training

Adapting Large Language Models (LLMs) to specific tasks usually involves fine-tuning: Low-Rank Adaptation (LoRA) edits the weights, while soft prompting prepends trainable virtual tokens. Both change how an already-optimized model is served, so serving many task-specific adapters at high throughput requires adapter-awa...

Michal Chudoba, Sergey Alyaev, Petra Galuscakova et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

JANUS: Evaluating Goal-Conditioned Distortion in Factually Grounded LLM Communication

LLM deception is often evaluated through fabricated claims, explicit lies, or strategic concealment. Yet misleading communication can also arise from selectively presenting true facts, for example, by omitting adverse evidence, softening unfavorable details, emphasizing favorable information, or replacing precise quali...

Polydoros Giannouris, Mohsinul Kabir, Sophia Ananiadou · 0 citations

Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution

This work introduces Code2LoRA, a hypernetwork framework that generates repository-specific LoRA adapters, effectively injecting repository knowledge with zero inference-time token overhead, and evaluates Code2LoRA against parameter-efficient fine-tuning baselines.

Liliana Hotsko, Yin-Xi Li, Yun-Tian Deng et al. · 6 citations

Self-Augmenting Retrieval for Diffusion Language Models

This work shows that intermediate states surface salient entities early in the denoising trajectory, making them a useful lookahead signal for retrieval-augmented generation (RAG), and demonstrates that grounding generation in retrieved evidence sharply reduces inter-token dependence, making RAG particularly well suite...

Paul J. Jünger, Justin Lovelace, Lin-Xi Zhao et al. · 2 citations · ⚡1
#artificial intelligence Preprint Open access Oct 2026

Executable Schema Contracts: From Automatic Ingestion to Multi-Source Retrieval

Real-world data spans tables, documents, and semi-structured files with implicit semantics. Querying this data requires integrating evidence across inconsistent schemas and formats, yet existing approaches either demand costly manual engineering or bypass structure entirely. We present a system that automatically disco...

Padmaja Jonnalagedda, Yuguang Yao, Xiang Gao et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Interpretability Is Not Just a Tax: Sparsity and Diversity Yield Legible and Composable Reward Experts for Personalization

Preference modeling aims to capture heterogeneous human values and increasingly relies on learning latent components to represent this variation without fine-grained supervision. What these components actually represent, however, is rarely examined. We audit Mixture-of-Experts (MoE) reward models along three rungs---se...

Yifan Wang, Jinyi Mu, Mayank Jobanputra et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.