Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Open access Oct 2026

Feature-Space Smoothing: Certified Robustness of Deep Representations

Modern deep learning models exhibit strong capabilities across diverse applications, yet remain vulnerable to malicious inputs that induce erroneous predictions via feature-space distortion. To address that, we propose Feature-Space Smoothing (FS), a representation-level certification framework built upon Gaussian rand...

Song Xia, Meiwen Ding, Chenqi Kong et al. · 0 citations
#machine learning Preprint Open access Oct 2026

On the Runway Cascade of Transformers for Language Modeling

In decoder-only (causal) transformers, the computation graph created by causal masking routes information through both direct-path attention and indirect paths formed by intermediate tokens. We denote these indirect paths between token pairs as their runways. We argue that certain failure modes of causal transformers a...

Hunjae Lee, Corey Clark · 0 citations
#machine learning Preprint Open access Oct 2026

Multi-Task Learning for Metal Alloy Property Prediction: An Empirical Study of Negative Transfer and Mitigation Strategies

Multi-task learning (MTL) in materials science relies on the assumption that physically related properties share learnable representations. We challenge this assumption using a 54,028-sample metal alloy dataset exhibiting extreme task-level imbalance. Our results reveal a striking dichotomy: MTL significantly degrades...

Sungwoo Kang · 0 citations
#machine learning Preprint Open access Oct 2026

Softly Symbolifying Kolmogorov-Arnold Networks

Kolmogorov--Arnold Networks (KANs) offer a promising path toward interpretable machine learning: their learnable activations can be studied individually while collectively fitting complex data accurately. In practice, however, trained activations often lack *symbolic fidelity*, learning pathological decompositions with...

James Bagrow, Josh Bongard · 0 citations
#machine learning Preprint Open access Oct 2026

Clip-Low Increases Entropy and Clip-High Decreases Entropy in Reinforcement Learning of Large Language Models

Reinforcement learning with verifiable rewards (RLVR) has recently emerged as the leading approach for enhancing the reasoning capabilities of large language models (LLMs). However, RLVR is prone to entropy collapse, where the LLM quickly converges to a near-deterministic form, hindering exploration and progress during...

Jaesung R. Park, Junsu Kim, Gyeongman Kim et al. · 0 citations
#machine learning Preprint Open access Oct 2026

From Dueling Bandits to Episodic MDPs: Learning with Adversarial Preference Feedback

In dueling bandits, the learner compares two arms in each round and observes only which one is preferred. This paper asks what changes when the compared pair also affects the next state, as in a recommendation interface where the pair shown to a user affects the user's next context. We formulate this problem as a state...

Taira Tsuchiya, Shinji Ito, Haipeng Luo · 0 citations
#machine learning Preprint Open access Oct 2026

Learning from Hypervectors: A Survey on Hyperdimensional Encoding

Hyperdimensional computing (HDC) is an emerging computing paradigm that imitates the brain's structure to offer a powerful and efficient processing and learning model. In HDC, the data are encoded with long vectors, called hypervectors, which typically range from 1,000 to 10,000 in length. The literature provides sever...

Sercan Aygun, Mehran Shoushtari Moghadam, M. Hassan Najafi et al. · 0 citations
#machine learning Preprint Nov 2022

FC-PINO: High Precision Physics-Informed Neural Operators via Fourier Continuation

The FC-PINO (Fourier-Continuation-based Physics-Informed Neural Operator) architecture is introduced, which extends the accuracy and efficiency of PINO and spectral differentiation to non-periodic and non-smooth PDEs and demonstrates that Fourier continuation is critical for extending PINO to a wider range of PDE probl...

Ha Maust, Valentin Duruisseaux, Zong-Yi Li et al. · 16 citations
#machine learning Preprint Open access Oct 2026

Maximum Likelihood on the Joint (Data, Condition) Distribution for Solving Ill-Posed Problems with Conditional Flow Models

In the absence of conditioning information, normalizing flow models are trained using maximum likelihood. Previous extensions to conditional settings have abandoned the simple maximum-likelihood approach, as obtaining the full joint distribution of data and conditions for training purposes (or equivalently, the true co...

John S. Hyatt · 0 citations
#machine learning Preprint Oct 2026

Flownomaly: Single-Step Conditional-Mean Recovery for Few-Shot Anomaly Detection

Few-shot industrial anomaly detection requires modeling category-specific normality from only a handful of defect-free images. Common approaches tie inference to stored exemplars, impose rigid linear structure, or risk reproducing anomalous content. Flownomaly instead casts the problem as normal-counterpart recovery in...

Bernardo Perrone Ribeiro, Erkut Akdag, E. Bondarev · 0 citations
#machine learning Preprint Open access Oct 2026

Measure Before You Train: Typed Decision Models vs. a Classical Baseline vs. a Generative LLM for Routing a Personal Multilingual Inbox

Personal email agents decide, for every message, what it is, whether it is urgent, whether to draft a reply, create a task, or ignore it. Their error rate is rarely measured: the stored labels were written by the system itself. We present Foyer, a self-hosted personal inbox agent in daily use, and a measurement protoco...

Federico Lucca · 0 citations
#machine learning Preprint Open access Oct 2026

Knowledge Distillation across Item and Code Spaces for Parallel Generative Recommendation

Generative recommendation with semantic IDs represents each item as a sequence of discrete codes derived from its semantic representation and predicts these codes to generate recommendations. Existing semantic-ID recommenders are typically trained with hard labels for the observed next item. Although such supervision i...

Yixuan Xu, Hailin Liu, Linxiang Peng et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.