Skip to content

Category

natural language processing

9,568 papers

#machine learning Preprint Open access Sep 2026

Refit the Probe: Single-Direction Ablation Is Not a Necessity Test

Probes are routinely paired with an intervention: ablate the direction the probe found, run the model, and read the change in task accuracy, taking a large drop as evidence that the computation depends on what the probe read and a near-zero drop as evidence that it does not. Either inference requires that the ablation...

Yuhang Jiang · 0 citations
#machine learning Preprint Open access Sep 2026

MONA: Muon Optimizer with Nesterov Acceleration for Scalable Language Model Training

The Muon optimizer has recently offered a promising alternative to AdamW for large language model training, leveraging matrix orthogonalization to produce geometry-aware updates. However, like all first-order methods, Muon can become trapped in sharp local minima. In this work, we present MONA, an optimizer that bridge...

Jiacheng Li, Jianchao Tan, Hongtao Xu et al. · 0 citations
#machine learning Preprint Sep 2026

Discovery-Driven Integration of Disjoint Tables via Text

Comprehensive evaluations on real-world benchmarks demonstrate that LOKI consistently outperforms state-of-the-art multi-modal data discovery approaches, and materializes typed integrated tables with 0.982 macro typed-pair precision while being up to 40 times cheaper in LLM API cost than direct prompting.

Md Ataur Rahman, Dimitris Sacharidis, Óscar Romero et al. · 0 citations

On the Lexical Superstition of Large Language Models for Code Comprehension: Re-evaluation on Code of Low Lexical Quality

Face/Off is introduced, a semantics-preserving identifier-renaming framework, and progressive naming conditions across multiple models and code-comprehension tasks are evaluated, revealing a systematic vulnerability in how current LLMs balance lexical cues against program structure.

Xin-Peng Shen, San-Zhuo Xi, Ya-Li Du et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Damage Predicts Recovery: When Calibration Data Matters in Compressing Financial LLMs

Post-training quantization and pruning rely on a small calibration corpus. Whether specialized domains such as finance require domain-matched calibration data remains unsettled. We argue that the answer depends on the task-level damage caused by compression rather than on domain mismatch. If compression preserves the t...

Junyi Ye, Mengjia Yu, Debapriya Hazra et al. · 0 citations
#machine learning Preprint Open access Sep 2026

One Domain, Many Tongues: Composing Domain and Language LoRAs for Cross-Lingual Remote-Sensing MLLMs without Paired Data

Remote-sensing (RS) multimodal large language models (MLLMs) are trained and evaluated only in English, while text-only instruction data covers over 100 languages. We propose MODL (Mutually Orthogonal Domain-Language composition), a recipe that adds new languages to an English RS MLLM without a single multilingual RS e...

Xuechen Li · 0 citations
#machine learning Preprint Open access Sep 2026

Optimizing Denoising Trajectories in dLLMs: A Lightweight Evolutionary Heuristic Approach

Diffusion Large Language Models (dLLMs) have recently emerged as a promising alternative to conventional Auto-Regressive (AR) Large Language Models (LLMs). By leveraging bidirectional attention and parallel decoding, dLLMs enable more efficient generation. However, they require a carefully designed denoising scheduler...

Zijian Zhao, Dian Jin, Xialiang Tong et al. · 0 citations
#machine learning Preprint Aug 2026

From Tone to Trajectory: Continuous Sentiment and the Shape of Monetary Policy Communication

Central bank press conferences are not merely information releases --- they are structured narratives. We study whether the shape of sentiment within a statement, not just its average tone, carries policy-relevant signals. Constructing sentiment arcs for ECB and Fed press conferences along three dimensions --- monetary...

Martin Feldkircher, Márton Kardos, K. Nielbo · 0 citations
#machine learning Preprint Jul 2026

What Does 99% Accuracy Measure? A Reproducible Audit of Shortcut Learning in a Widely Used Fake News Corpus

Text classifiers trained on the ISOT/Kaggle "Fake and Real News"corpus routinely report accuracy and F1 above 0.98, which concludes that within-corpus scores here quantify source and topic separability rather than veracity, and is recommended metadata-only, small-sample, and topic-disjoint baselines as inexpensive diag...

Yuvraj Verma · 0 citations
#machine learning Preprint Sep 2026

MICRO: Multi-Fidelity Active Search for Severe Error Discovery

Human feedback can vary in cost and informativeness. Strong feedback can reveal severe errors but is costly, so cheaper quality ratings can help decide which items to annotate. We propose MICRO (Multi-Fidelity Impact Clustered Rollout), an active search framework that allocates a shared budget to these feedback types t...

Orlando Leone, Niclas Pokel, P. Moure et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.