Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Open access Sep 2026

No More Free Lunch: Corpus Task Complexity Matters as Corpora Grow

Given a large corpus, the questions one might ask can vary -- from "When was the first human heart transplant?" to "What are all the contradictory claims in this literature?" -- but what makes some questions more challenging than others? In this work, we define a notion of Corpus Task Complexity (CTC) that characterize...

Prasann Singhal, Amanda Bertsch, Jacob Steinhardt et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Tag-Aware Structured Text Translation: Towards a Systematic Understanding

Internet texts are replete with format tags that carry structural, semantic, and functional meaning. Current large language model (LLM)-based translation systems struggle to balance translation fluency with tag fidelity when processing tagged text. We argue that resolving this tension requires a systematic approach at...

Zhanglin Wu, Hengchao Shang, Dai-Meng Wei et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Can Classical Semantic-Extractive Summarization Be Evaluated in Hindi? A Replication Study

We replicate the distributional-semantics extractive summarisation method of Mohd, Jan and Shah (2020) and adapt it to Hindi, substituting a Devanagari-appropriate component at every language-specific step. The system is evaluated on two independent corpora --- the Hindi portion of XL-Sum and FIRE ILSUM 2.0 Hindi --- u...

Showket Ahmad Khan, Mudasir Mohd, Nasrullah Sheikh et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Empath: Tracing Multi-Level Emotion Dynamics in Crisis Counseling Dialogues

Emotion dynamics are critical for understanding crisis-support conversations, yet most computational work treats emotion as static utterance-level labels. We introduce EMPATH, a framework for understanding affective dynamics in mental health dialogues across three granularities: turn-level labels, transition probabilit...

Ziwei Gong, Yu-Chen Huang, Wen Liang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Design and Evaluation of LLM Chaining-Based Task Planning for General Purpose Service Robots

This work proposes an LLM chaining architecture that separates instruction classification and action generation into two specialized stages, reducing per-inference prompt length by approximately 45% while improving planning consistency.

Lucas Da Mota Bruno, Jiahao Sim, Y. Hagiwara · 0 citations
#artificial intelligence Preprint Sep 2026

Persuaded, Not Informed: Incentive-Misaligned Witnesses Defeat In-Context Grounding

This work identifies a failure mode not addressed by a stronger model: when the context contains an assertion by a party with an incentive toward optimism - here the sales representative, a witness recorded in the CRM - the model treats the assertion as evidence and clears deals the company's own records deem unaccepta...

Rahul Balakavi · 1 citation
#artificial intelligence Preprint Sep 2026

Technical Manual for Toolkit for Confidence-Corpus Consistency via Fine-Tuning on a Fabricated Corpus

A language model's confidence in an answer is often read as a proxy for how well it knows the corresponding fact. This manual documents an open toolkit built to test that reading directly: a small causal language model is fine-tuned on a corpus that consistently asserts one fabricated arithmetic answer for each of the...

Jos\'e Luciano Ver\c{c}osa Marques, Frederico Jorge Heitmann, Daniel Omar Perez et al. · 0 citations
#artificial intelligence Preprint Sep 2026

An Explainable DistilBERT-BiLSTM-Attention Framework for Binary and Multi-Class Hate Speech Detection

The results demonstrate that multilevel evaluation improves the reliability that the proposed framework effectively balances performance and efficiency, which makes the framework suitable for practical hate speech moderation systems that require accurate, generalizable, and explainable decisions.

Rameesha Zia, Muhammad Shahid Iqbal Malik · 0 citations
#artificial intelligence Preprint Open access Sep 2026

When Explanations Cannot Be Read: Measuring and Correcting SHAP and LIME Rendering for Right-to-Left Languages

Post hoc explanation methods such as SHAP and LIME are widely used to interpret text classifiers, but their visualizations are mainly designed for left-to-right languages. When applied to right-to-left (RTL) languages such as Urdu, Arabic, Persian, and Hebrew, the attribution values remain mathematically valid, while t...

Rameesha Zia, Muhammad Shahid Iqbal Malik · 0 citations
#artificial intelligence Preprint Sep 2026

ExplorationBench: Measuring AI Systems'Exploration in Verifiable Alien Worlds

ExplorationBench turns the wicked problem of evaluating scientific exploration into a concrete and tractable framework built on verifiable Alien Worlds, and finds that the strongest systems can acquire and apply unfamiliar rules, while performance varies substantially across trajectories and continued exploration can s...

Ming Zhang, Zhen Xiang, Pei-Zhong Gao et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.