Skip to content

Category

natural language processing

9,261 papers

#machine learning Preprint Open access Nov 2026

Task Vectors Can Be Linearly Decomposed into Interpretable and Controllable Components

Task Vectors (TVs) provide a compact way to steer large language models, but they are typically treated as atomized directions merely extracted from hidden states, leaving their internal functional structure poorly understood. Motivated by prior work that decomposes in-context learning into Task Recognition (TR) and Ta...

Yukiya Horiba, Hakaze Cho, Takahiro Yakoh · 0 citations
#machine learning Preprint Open access Nov 2026

Leakage-Controlled Structure-Preserving Augmentation and Template-Aware Evaluation for Bangla Symptom-Based Disease Prediction

Bangla symptom-based disease prediction is commonly evaluated on a small, imbalanced structured benchmark containing many profiles that differ by only one or two symptoms. We test whether train-only asymmetric Bernoulli perturbation improves classification using 725 unique profiles spanning 85 diseases and 172 binary s...

Sabah Nushra, Shovan Samanta Turzo, Moinul Hossain et al. · 0 citations
#machine learning Preprint Oct 2026

UpLoop: Training Looped Transformers via Upcycling at No Extra Pretraining Compute

Looped language models can strengthen reasoning through repeated computation with shared weights, increasing execution depth without adding independent parameters. However, each additional pass increases training floating-point operations (FLOPs), making these gains more expensive to obtain. To address this cost, we pr...

Cheng Liang, Teng-Fei Zhang, Ya Zhang et al. · 0 citations
#machine learning Preprint Open access Nov 2026

Does Reasoning Make Language Models Agree?

Language models face two opposing concerns: monoculture, in which models err in correlated ways, and multiplicity, in which equally accurate models make conflicting decisions. The rise of reasoning models has complicated this debate: On the one hand, reasoning may increase model agreement if models anchor on the same s...

Mila Gorecki, Moritz Hardt · 0 citations
#machine learning Preprint Open access Nov 2026

Enhancing Sentiment Classification on Small Datasets through Data Augmentation and Transfer Learning

Small-scale sentiment classification often suffers from data scarcity, which limits the generalization ability of the models. This study evaluates and compares the effectiveness of three data augmentation strategies: Easy Data Augmentation (EDA), back-translation, and contextual token substitution (nlpaug-style), with...

Mahmoud S. Mayaleh, Samer A. Mayaleh · 0 citations
#machine learning Preprint Open access Nov 2026

What We Keep of What We Forget: Replacement Operators and Routing Semantics in Training-Free MoE Expert Pruning

Training-free expert pruning makes two decisions: which experts to remove, and what the layer computes when its router still selects a removed expert. Published methods change both at once. Holding the mask fixed, we compare replacement operators from three families on OLMoE, DeepSeek-V2-Lite and Moonlight, with Granit...

Ezza Ali, Sehrish Bibi, Momina Moetesum et al. · 0 citations
#machine learning Preprint Oct 2026

MOSAIC: Addressing Disproportionate Task-Modality Dependencies via Modality-Partitioned Gradient Routing

MOSAIC (MOdality-Separated Architecture with Inter-modal Cross-attention), which preserves unimodal representations while enabling controlled interaction between them, and uses modality-specific losses to route gradients to their corresponding partitions, demonstrates that modality partitioning yields consistent gains...

Aryan Chowdhury, Yi-Zheng Sun, Thomas Carroll et al. · 0 citations
#machine learning Preprint Oct 2026

FARO: Function-Space Adaptive Return-to-Risk Optimization via Cross-Block Equal-Risk-Contribution Budget Allocation

FARO, a function-space adaptive optimizer that makes the partition of parameters into blocks the unit of decision, is introduced, a function-space adaptive optimizer that makes the partition of parameters into blocks the unit of decision.

Xiao-Jun Wu, Ce-Hao Yang, Xuhui Jiang et al. · 0 citations

EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective

This paper studies agent memory from a self-evolving perspective and introduces EvoMemBench, a unified benchmark organized along two axes: memory scope (in-episode vs. cross-episode) and memory content (knowledge-oriented vs. execution-oriented).

Yu-Yao Wang, Zhongjian Zhang, Mo-Han Chi et al. · 21 citations · ⚡1
#artificial intelligence Preprint Open access Nov 2026

M$^\star$: Every Task Deserves Its Own Memory Harness

Large language model agents rely on a memory harness to write, organize, retrieve, and use past experience. A harness that works for one task often fails on another, because conversations, embodied planning, and expert reasoning require different storage and retrieval behavior. To address this limitation, we introduce...

Wenbo Pan, Shujie Liu, Xiangyang Zhou et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Enhancing Safety of Large Language Models via Embedding Space Separation

Safety alignment does not fully prevent large language models (LLMs) from producing harmful content under adversarial attacks. We observe that existing attack methods typically move harmful embeddings toward regions of harmless embeddings. This motivates us to explore whether increasing the distance between harmful and...

Xu Zhao, Xiting Wang, Weiran Shen · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.