Skip to content

Category

natural language processing

9,261 papers

#natural language process... Preprint Open access Oct 2026

ASR-Style Transcript Normalization Removes Useful Pragmatic Signal for Dialogue Act Classification

Automatic speech recognition (ASR) pipelines often normalize transcripts by removing filled pauses and punctuation and expanding colloquial forms, potentially discarding cues useful for dialogue act classification. We evaluate nine transcript conditions across six classifiers (TF-IDF logistic regression, RoBERTa, BERT,...

Lucky Onyekwelu-Udoka, Md Shafiqul Islam · 0 citations
#natural language process... Preprint Oct 2026

Bengali Hallucination Detection with Retrieval and Programs: A System Study

Bengali hallucination detection must distinguish unsupported factual claims from incorrect reasoning, often without a supplied reference passage. We present and characterize an inference-only system that combines response-conditioned query rewriting, hybrid retrieval, and task-specific language-model judging. Six retri...

Shamim Hasan, Samiya Chowdhury · 0 citations
#natural language process... Preprint Open access Oct 2026

NLData2Opt: Benchmarking Parameter Derivation and Prediction for Modeling Optimization Problems from Natural Language and Data

Formulating optimization problems from raw inputs of problem descriptions and data is time-consuming and costly. While Large Language Models (LLMs) offer a promising way to automate this process, existing benchmarks overestimate their capabilities by relying on idealized inputs where all data is relevant and complete....

Lijia Liu, Kyohei Atarashi, Jiyi Li et al. · 0 citations
#natural language process... Conference Open access Oct 2026

Identify, Classify, Act: Per-Instruction Controlled Compliance for LLMs over External Data

Across two backbones and five benchmarks, EDIC improves both safety and utility over the strongest prior defense, lifting harmful-rejection by up to 7.7\% and Arena-Hard-Auto utility by 12.5\% on Qwen3-4B.

Ze-Sheng Shi, Xue Li, Chen-Rui Dai et al. · 1 citation
#artificial intelligence Preprint Open access Oct 2026

Uncertainty-Aware Budget Allocation for Efficient LLM Tree Search

Tree search enhances multi-step reasoning in large language models (LLMs), yet prevailing methods expand every step with a fixed budget, irrespective of the marginal utility of expansion. We first show, across existing search algorithms, that continuations sampled from a shared intermediate state are largely duplicates...

Jianguo Huang, Zhiyi Lyu, Fuxiang Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

The Reliance Hypothesis: Chain-of-Thought Faithfulness Rises as Language Resource Level Falls

Chain-of-Thought (CoT) faithfulness matters for monitoring, explaining and safely deploying large language models, yet it has been studied mostly in English. Languages differ in level, the amount of text available to learn from, so models know less in lower-resource languages, which may change how much they rely on the...

Lucas Resck, Jingyi Sun, Qianli Wang et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Watermarkability: Measuring and Improving Language-Model Compatibility with Logit-Based Watermarks

Language-model watermarks can help identify model-generated text, encode provenance information, and detect post-generation edits. A broad class of logit-based watermarks increases the logits of a designated token set at each decoding step. Because a base model's native probability mass on this set varies across contex...

Zewei Deng, Mohamed Seif, Liyan Xie · 0 citations
#natural language process... Preprint Oct 2026

On the Position Bias of Large Language Models: A Comprehensive Study

Recent studies have shown that position bias remains a critical vulnerability in large language models (LLMs), undermining both the integrity of multiple-choice evaluations and the reliability of retrieval-augmented generation. However, existing understanding of this phenomenon is largely derived from studies with limi...

Yi-Ning Li, Huayang Li, Le-Mao Liu et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Causal Latent Workspaces for Looped Transformers

Reusing a Transformer block across depth increases computation without replicating its parameters, but successive passes have no dedicated state through which positions can exchange compact summaries of their causal prefix. We introduce the causal latent workspace Transformer: an anchored, four-round shared-depth archi...

Ilia Zaznov · 0 citations
#artificial intelligence Preprint Oct 2026

Prune the Leaky Neurons: Mitigating Private Data Leakage in Fine-Tuned LLMs via Joint-Embedding-Guided Pruning

JEPA-Prune is proposed, a post-hoc neuron pruning framework guided by a model trained exclusively on PII-free views, which trains a public model on surrogate and masked views of the same records using a joint-embedding predictive architecture (JEPA), capturing domain knowledge without identifiers.

M. Shaaban, Mohamed Elmahallawy · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Self-Evolving Coding Agents via Harness-Policy Optimization

Large language model (LLM) agents have shown promising potential in coding tasks, and their performance is jointly determined by the policy model and the harness that mediates their interaction with the environment. Indeed, harness and policy are mutually reinforcing and evolving only one component is suboptimal---a ha...

Zhepei Wei, Wenlin Yao, Baolin Peng et al. · 0 citations
#natural language process... Preprint Oct 2026

Thunder-DeID+: Boundary-Aware Korean De-identification from Court Judgments to Broader Sensitive Documents

Thunder-DeID+, which integrates a refined three-tier PII taxonomy with a boundary-aware tokenizer, is introduced, which enhances a pretrained BPE vocabulary by incorporating N-gram and boundary-scoring components to better align token and PII span boundaries.

Gyuseong Lee, Gyeongje Cho, Jongmin Kim et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.