It is proved that it removes the visibility of tail mass, not the freedom to move it, in the top-k distillation pipeline: keep the top-k probabilities, renormalize, and minimize a divergence on what remains.
Settling one comparison between two truncation samplers has cost six thousand A100-hours, and nothing says in advance how far apart two samplers can be. We observe that almost every deployed truncation rule keeps a prefix of the probability-sorted vocabulary, so any two such rules are nested at every decoding step. Nes...
We introduce UNISON, a unified framework that bridges multiple instance learning and recommendation systems by treating both as instances of learning from scored bag collections of (item, score) pairs. Unlike traditional approaches that address bag-level classification and personalized recommendation as separate proble...
Ofek Kirshenboim, Or Shkuri, Shani Finkelshtein et al.· 0 citations
Deep-learning models increasingly rival numerical simulation in Earth-system forecasting, yet forecast error alone cannot determine whether their learned input-output dependencies are physically consistent. Here we introduce sensitivity fidelity as an additional criterion: alongside prediction error, model responses to...
Qi Chen, Peng Zhan, Hong-Xing Cui et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
The theoretical elegance of Support Vector Machines (SVMs), grounded in statistical learning theory, establishes them as a reference for robust classification. However, in the era of Big Data, classical SVMs face two major bottlenecks: the prohibitive cubic complexity $\mathcal{O}(N^3)$ of training and the rigidity of...
Nassou Gongon Benjamin, Noulapeu Ngaffo, Patrick Njionou Sadjang· 0 citations
Existing analyses of interval length in split conformal prediction largely focus on clean data. However, how contamination at the training and calibration stages alters interval length relative to the corresponding clean population oracle remains understudied. In this paper, we consider Huber contamination and derive a...
Foundation models are at the forefront of artificial intelligence. A tokenizer, converting the raw input into discrete representations that the model can understand, plays an important role to the success of foundation models. Unlike the text tokenizer that is well studied in large language models, graph tokenizer is s...
Qimin Zhou, Haibo Liu, Yujie Wang et al.· 0 citations
The proposed exploration-augmented key-observation gating first determines whether the current RL episode is judgment-worthy based on its similarity to a generated success trajectory, and proposes VLM success reward via Exploration-Augmented Key-Observation Gating (VLMeg) to well harness VLM for embodied reward design.
Xin Liu, Yu-Tong Jiang, Jia-Yue Su et al.· 0 citations
Large language models (LLMs) demonstrate strong generalization across a broad range of reasoning and generation tasks, but their large parameter counts impose substantial memory and computation costs, hindering deployment in practical resource-constrained settings. One-shot low-rank compression is a promising solution...
Sheng-Kun Tang, Cong Zeng, Zong-Fang Liu et al.· 0 citations
Structured pruning is typically formulated as identifying which model dimensions to remove, often within the model's original representation. However, the effect of coordinate deletion fundamentally depends on the basis in which pruning is performed. This raises a more fundamental question: how should the basis be chos...
Shengkun Tang, Dan Alistarh, Zhiqiang Shen· 0 citations
Target-conditioned cyclic peptide design requires coordinating interfacial side chains with macrocyclic closure. Existing end-to-end generators concurrently update geometric and chemical variables from noise, assigning residues to disordered coordinates. Meanwhile, predictor-assisted workflows often get stuck in local...
Yitian Wang, Minjie Cheng, Yaning Cui et al.· 0 citations
Contrastive representation learning (CRL) is a fundamental paradigm for
learning transferable representations. Recent work
identifies its population target as the pointwise mutual information (PMI)
$\log\frac{p(x,y)}{p_X(x)p_Y(y)}$
between two modalities $X,Y$, where $p$ is the joint density function and
$p_X...
Yuanfan Li, Zihan Zhang, Yiming Ying et al.· 0 citations
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.