Skip to content

Category

machine learning

18,068 papers

#machine learning Preprint Oct 2026

The Gradient That Top-k Distillation Never Computes

It is proved that it removes the visibility of tail mass, not the freedom to move it, in the top-k distillation pipeline: keep the top-k probabilities, renormalize, and minimize a divergence on what remains.

Rasul Khanbayov, Hasan Kurban · 0 citations
#machine learning Preprint Open access Oct 2026

Truncation Samplers Are Nested: Comparing Decoding Rules Is a Measurement Problem

Settling one comparison between two truncation samplers has cost six thousand A100-hours, and nothing says in advance how far apart two samplers can be. We observe that almost every deployed truncation rule keeps a prefix of the probability-sorted vocabulary, so any two such rules are nested at every decoding step. Nes...

Rasul Khanbayov, Hasan Kurban · 0 citations
#machine learning Preprint Open access Oct 2026

UNISON: A Unified Framework for Learning from Scored Bags

We introduce UNISON, a unified framework that bridges multiple instance learning and recommendation systems by treating both as instances of learning from scored bag collections of (item, score) pairs. Unlike traditional approaches that address bag-level classification and personalized recommendation as separate proble...

Ofek Kirshenboim, Or Shkuri, Shani Finkelshtein et al. · 0 citations
#machine learning Preprint Oct 2026

Sensitivity Fidelity Reveals Physical Dependencies Beyond Forecast Accuracy in Deep-Learning Earth-System Models

Deep-learning models increasingly rival numerical simulation in Earth-system forecasting, yet forecast error alone cannot determine whether their learned input-output dependencies are physically consistent. Here we introduce sensitivity fidelity as an additional criterion: alongside prediction error, model responses to...

Qi Chen, Peng Zhan, Hong-Xing Cui et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Revisited Support Vector Machines: A Unified Joint Optimization Framework with Nystr\"om Approximation for Scalable Adaptive Learning

The theoretical elegance of Support Vector Machines (SVMs), grounded in statistical learning theory, establishes them as a reference for robust classification. However, in the era of Big Data, classical SVMs face two major bottlenecks: the prohibitive cubic complexity $\mathcal{O}(N^3)$ of training and the rigidity of...

Nassou Gongon Benjamin, Noulapeu Ngaffo, Patrick Njionou Sadjang · 0 citations
#machine learning Preprint Oct 2026

Split Conformal Interval Length under Huber Contamination

Existing analyses of interval length in split conformal prediction largely focus on clean data. However, how contamination at the training and calibration stages alters interval length relative to the corresponding clean population oracle remains understudied. In this paper, we consider Huber contamination and derive a...

Xiao Zhang, Bo-Wen Zhang, Lie He · 0 citations
#machine learning Preprint Open access Oct 2026

Riemannian Graph Tokenizer for Structural Knowledge Transfer

Foundation models are at the forefront of artificial intelligence. A tokenizer, converting the raw input into discrete representations that the model can understand, plays an important role to the success of foundation models. Unlike the text tokenizer that is well studied in large language models, graph tokenizer is s...

Qimin Zhou, Haibo Liu, Yujie Wang et al. · 0 citations
#machine learning Preprint Oct 2026

Harnessing VLM in Embodied RL: From Reward Regressor to Success Detector via Exploration-Augmented Key-Observation Gating

The proposed exploration-augmented key-observation gating first determines whether the current RL episode is judgment-worthy based on its similarity to a generated success trajectory, and proposes VLM success reward via Exploration-Augmented Key-Observation Gating (VLMeg) to well harness VLM for embodied reward design.

Xin Liu, Yu-Tong Jiang, Jia-Yue Su et al. · 0 citations
#machine learning Preprint Oct 2026

GA-SVD: Generation-aware Singular Value Decomposition for LLM Compression

Large language models (LLMs) demonstrate strong generalization across a broad range of reasoning and generation tasks, but their large parameter counts impose substantial memory and computation costs, hindering deployment in practical resource-constrained settings. One-shot low-rank compression is a promising solution...

Sheng-Kun Tang, Cong Zeng, Zong-Fang Liu et al. · 0 citations
#machine learning Preprint Open access Oct 2026

WUSPruner: Second-Moment-Optimal Transforms for Structured Pruning

Structured pruning is typically formulated as identifying which model dimensions to remove, often within the model's original representation. However, the effect of coordinate deletion fundamentally depends on the basis in which pruning is performed. This raises a more fundamental question: how should the basis be chos...

Shengkun Tang, Dan Alistarh, Zhiqiang Shen · 0 citations
#machine learning Preprint Open access Oct 2026

DC-Flow: Target-Conditioned Cyclic Peptide Design via Delayed-Coupling Flow Matching

Target-conditioned cyclic peptide design requires coordinating interfacial side chains with macrocyclic closure. Existing end-to-end generators concurrently update geometric and chemical variables from noise, assigning residues to disordered coordinates. Meanwhile, predictor-assisted workflows often get stuck in local...

Yitian Wang, Minjie Cheng, Yaning Cui et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Approximation in Contrastive Representation Learning

Contrastive representation learning (CRL) is a fundamental paradigm for learning transferable representations. Recent work identifies its population target as the pointwise mutual information (PMI) $\log\frac{p(x,y)}{p_X(x)p_Y(y)}$ between two modalities $X,Y$, where $p$ is the joint density function and $p_X...

Yuanfan Li, Zihan Zhang, Yiming Ying et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.