Task Vectors (TVs) provide a compact way to steer large language models, but they are typically treated as atomized directions merely extracted from hidden states, leaving their internal functional structure poorly understood. Motivated by prior work that decomposes in-context learning into Task Recognition (TR) and Ta...
Bangla symptom-based disease prediction is commonly evaluated on a small, imbalanced structured benchmark containing many profiles that differ by only one or two symptoms. We test whether train-only asymmetric Bernoulli perturbation improves classification using 725 unique profiles spanning 85 diseases and 172 binary s...
Sabah Nushra, Shovan Samanta Turzo, Moinul Hossain et al.· 0 citations
Looped language models can strengthen reasoning through repeated computation with shared weights, increasing execution depth without adding independent parameters. However, each additional pass increases training floating-point operations (FLOPs), making these gains more expensive to obtain. To address this cost, we pr...
Cheng Liang, Teng-Fei Zhang, Ya Zhang et al.· 0 citations
Language models face two opposing concerns: monoculture, in which models err in correlated ways, and multiplicity, in which equally accurate models make conflicting decisions. The rise of reasoning models has complicated this debate: On the one hand, reasoning may increase model agreement if models anchor on the same s...
Mila Gorecki, Moritz Hardt· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Small-scale sentiment classification often suffers from data scarcity, which limits the generalization ability of the models. This study evaluates and compares the effectiveness of three data augmentation strategies: Easy Data Augmentation (EDA), back-translation, and contextual token substitution (nlpaug-style), with...
Training-free expert pruning makes two decisions: which experts to remove, and what the layer computes when its router still selects a removed expert. Published methods change both at once. Holding the mask fixed, we compare replacement operators from three families on OLMoE, DeepSeek-V2-Lite and Moonlight, with Granit...
Ezza Ali, Sehrish Bibi, Momina Moetesum et al.· 0 citations
MOSAIC (MOdality-Separated Architecture with Inter-modal Cross-attention), which preserves unimodal representations while enabling controlled interaction between them, and uses modality-specific losses to route gradients to their corresponding partitions, demonstrates that modality partitioning yields consistent gains...
Aryan Chowdhury, Yi-Zheng Sun, Thomas Carroll et al.· 0 citations
FARO, a function-space adaptive optimizer that makes the partition of parameters into blocks the unit of decision, is introduced, a function-space adaptive optimizer that makes the partition of parameters into blocks the unit of decision.
Xiao-Jun Wu, Ce-Hao Yang, Xuhui Jiang et al.· 0 citations
This paper studies agent memory from a self-evolving perspective and introduces EvoMemBench, a unified benchmark organized along two axes: memory scope (in-episode vs. cross-episode) and memory content (knowledge-oriented vs. execution-oriented).
Yu-Yao Wang, Zhongjian Zhang, Mo-Han Chi et al.· arXiv.org· 21 citations· ⚡1
Large language model agents rely on a memory harness to write, organize, retrieve, and use past experience. A harness that works for one task often fails on another, because conversations, embodied planning, and expert reasoning require different storage and retrieval behavior. To address this limitation, we introduce...
Wenbo Pan, Shujie Liu, Xiangyang Zhou et al.· 0 citations
The results indicate that user-side detection is not a viable defense and motivate system-level countermeasures such as cryptographic content provenance.
Alexander Loth, Martin Kappes, M. Pahl· Web Science Conference· 3 citations
Safety alignment does not fully prevent large language models (LLMs) from producing harmful content under adversarial attacks. We observe that existing attack methods typically move harmful embeddings toward regions of harmless embeddings. This motivates us to explore whether increasing the distance between harmful and...
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.