Skip to content

Category

natural language processing

9,568 papers

Consequential Behaviour and Representational Fairness in the Validation of Synthetic Research

Researchers in industry and academia use synthetic survey respondents powered by large language models as substitutes for human samples. These synthetic populations require validation against real-world data, so researchers often address them using ad hoc comparisons with human surveys. Inspired by the intention-behavi...

F. Kutzner, C. Kacperski, Laura de Molière et al. · 1 citation
#natural language process... Preprint Sep 2026

Same Scores, Different Decisions: Evaluating JEV and Language Models for Legal Document Understanding

Jev has the lowest cost and median response time among the evaluated configurations, while hosted language models achieve higher baseline accuracy and Rankings by baseline accuracy differ from rankings by correctness across every condition and repeat, although small differences in the latter do not establish a general...

Fan Zhang, Yan-Kai Chen, Zhuo-Han Xie et al. · 13 citations · ⚡1
#artificial intelligence Preprint Sep 2026

The Path Matters: Evaluating Small Language Models Beyond Answer Accuracy in KGQA

This work isolates SLM graph reasoning from navigation and traceability capability by employing the THESEUS navigation and traceability framework and using frozen, off-the-shelf SLMs as local action policies, and results motivate evaluating SLM graph reasoning beyond endpoint accuracy alone.

Eduin E. Hernandez, Sergio A. Diaz, Luis F. Garcia et al. · 1 citation

Brain-to-Language Decoding: Tasks, Signals, Methods, Evaluation, Practical Use and Beyond

This survey connects Articulated, Inner and Perceived tasks to the neural populations they engage, the representations available to decoders and the outputs those representations can support, and outlines a prospective five-level trajectory from commands and language to meaning, scenarios and bidirectional cognitive ex...

Yi-Qian Yang, Yi-Qun Duan, Chen-Yu Liu et al. · 1 citation
#artificial intelligence Preprint Sep 2026

Can Jev Judge Radiology Reports? Evaluating a System One Model for Clinical Factuality

Findings and error-scope analyses show that benchmark agreement reflects report size and error definitions as well as medical error detection, and local RadMatch achieves stronger agreement on clinically significant errors in both expert datasets and on total errors in the shared RadEvalExpert subset.

Jia-Ju Huang, Hao Yang, Xin-Yu Ma et al. · 7 citations · ⚡1
#artificial intelligence Preprint Sep 2026

When Context Misleads: In-context Learning with Jurisdiction in Large Language Models

J-ICL is proposed, a post-training framework that incorporates context validation into the training objective and improves ICLEval and reality accuracy by an average of 5.84 percentage points and reality accuracy by 9.20 points over the corresponding base models.

Pei-Lin Li, Qing-Le Liu, Jun-Yang Feng et al. · 0 citations
#natural language process... Preprint Sep 2026

MWE-ECL: Recoverable Long-Range Context Does Not Always Override Local Lexical Priors

This work introduces Multiword Expression Effective Context Length (MWE-ECL), a bilingual diagnostic whose matched anchor-retrieval, no-anchor prior, and interpretation prompts measure explicit recoverability, model-observed defaults, and anchor-conditioned decisions, respectively.

Wei He, Aline Villavicencio, R. Wilkens et al. · 0 citations
#natural language process... Preprint Sep 2026

ThaiTrees: Thai Syntactic Dependency Trees Across Domains

This work develops a reproducible pipeline for cleaning, processing, and parsing Thai text under the Universal Dependencies framework and releases a frequency lexicon and CoNLL-U parses in machine-readable formats suitable for both AI-assisted and conventional programmatic analysis.

Attapol T. Rutherford, Papatchol Thientong · 0 citations
#artificial intelligence Preprint Sep 2026

Uncheatable Eval: Dynamic Compression-Based Evaluation of Language Models

This work uses compression rate to evaluate how well models predict new text, and results yield three main findings: compression performance follows a consistent scaling trend with model size, and lower compression rates are strongly associated with higher zero-shot MMLU accuracy.

Kai-Feng Tan, Yu-Dong Li, LinLin Shen · 0 citations

EviStreams: Human-in-the-Loop AI Data Extraction for Systematic Reviews in Medicine

Systematic reviews underpin clinical guidelines, yet their data-extraction step is a major expert-labor bottleneck bound by a protocolized workflow: two reviewers extract each study independently, an adjudicator resolves disagreements, and the team keeps an auditable record of how every value was produced. Large langua...

S. Kosuri, A. Bhosale, M. Glick et al. · 0 citations
#natural language process... Preprint Sep 2026

When Parallel Drafter Meets Parallel Speculative Decoding

DPara is a PSD framework that reuses effective parallel drafters yet guarantees backbone--verification overlap in every round, thereby eliminating this probabilistic fallback altogether and surpassing the strongest serial and parallel speculative decoding baselines alike.

Fu-Liang Liu, Xue Li, Kun Qian et al. · 1 citation

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.