Skip to content

Category

machine learning

18,068 papers

#artificial intelligence Preprint Open access Oct 2026

Sparse Autoencoders Are a Shared Coordinate System for Symbolic Matching

Large language models (LLMs) hold broad knowledge in one set of weights, but lack interpretability and trustworthy reasoning, especially in high-stakes use cases. A neuro-symbolic model, with its interpretable architecture and System 2 reasoning capacity, is a promising alternative if built at the scale of LLMs; howeve...

Xiaocong Yang, Xuanyu Meng, Yuji Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Divergent Paths: Learning an Outcome-Predictive Representation of LLM Agent Trajectories

This work reframe agentic trajectories as paths through a shared embedding space of actions and environmental observations, and introduces Precog-RM, a transformer-based model that meta-learns a representation in which outcome prediction can be performed in a few-shot setting.

Alexander Gill, Guram Gogia, F. Guzmán · 0 citations
#machine learning Preprint Open access Oct 2026

PN-Mix: Pair-Norm Guided Mixed-Precision Key Cache Quantization for Efficient Long-Output LLM Inference

Long-output inference in large language models suffers from severe KV cache memory and bandwidth bottlenecks. While KV cache quantization alleviates this issue, low-bit quantization (e.g., 2-bit) severely degrades model accuracy. Recent mixed-precision key-cache quantization methods mitigate this degradation by allocat...

Gil Jae Song, Sungjoo Yoo · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Beyond Static Positional Encoding: Bayesian Time-aware Attention for Non-Stationary Long-term Time Series Forecasting

Transformers have demonstrated strong performance in long-term time series forecasting (LTSF), yet modeling non-stationary temporal dependencies remains challenging. In this paper, we interpret self-attention as a Bayesian posterior over attended positions, combining a content-based prior induced by scaled dot-product...

Xinjie Lan, Yunbo Mei, Leheng Zhou et al. · 0 citations
#machine learning Preprint Oct 2026

InstructPro2: Natural Language and Biological Grounding Guided De Novo Protein Design

The ability to generate proteins with desired functions is a central goal of computational biology. Although natural language can express diverse design objectives, existing protein generation methods often support only narrow tasks or make limited use of biological constraints. We develop InstructPro2 to translate nat...

Charles Novak, Zhenqiao Song, Chuan Li et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Learning Across Temporal Graph Representation Silos

Temporal graph data are recorded in different representations, but whether these differences also determine the scope of learned knowledge reuse remains unclear. This study investigates whether predictive structure learned from relational histories can be reused between continuous-time dynamic graphs (CTDGs) and tempor...

Min-Woo Yu, Young-Guk Ha · 0 citations
#artificial intelligence Preprint Open access Oct 2026

TEX-MEX: Similarity-Guided Temporal Contrastive Learning for Time Series

Contrastive learning for time series depends on deciding which pairs of inputs should be treated as similar and dissimilar. Because few augmentations reliably preserve meaning in time series, prior methods have relied on two disjoint notions of similarity between windows: structural similarity, which relates windows wi...

Aditya Radhakrishnan, Maxwell A. Xu, Wanting Mao et al. · 0 citations
#machine learning Preprint Oct 2026

Test-Time Forecasting: Recurrent Depth Enables In-Context Dynamics Prediction

Foundation models for dynamical systems can forecast unseen partial differential equations (PDEs), ordinary differential equations (ODEs), and time series during inference. However, it remains an open question whether these foundation models truly learn generalizable in-context forecasting strategies. We show that loop...

Jeffrey Lai, John Quinn, Anthony Bao et al. · 1 citation
#machine learning Preprint Oct 2026

Two-stage Residual Learning for Modelling Strength-Informed Optimisation of Thermal Systems

This study assesses local modelling strength through validation-based reliability screening and post-optimisation residual assessment of the TSRL framework for modelling-strength-informed and domain-constrained optimisation of thermal systems.

Talha Ansar, W. M. Ashraf, Abdulelah S. Alshehri et al. · 0 citations
#machine learning Preprint Oct 2026

Diagnosing and Correcting Reward Hacking in Verifiable Instruction Following

CALIF is a lightweight method that augments verifier rewards with a calibrated likelihood-based bonus to preserve response quality and outperforms corresponding base policies in 40 of 45 model-metric comparisons across three rubric-based instruction-following benchmarks.

Sangyeon Yoon, Wooseok Seo, Hamish Ivison et al. · 0 citations
#machine learning Preprint Oct 2026

HankelKANet: Lightweight Path Loss Estimation via Physics-Inspired Hankel Convolution

Accurate path loss (PL) estimation is essential for wireless network planning and optimization. This paper proposes HankelKANet, a lightweight physics-inspired network for PL estimation that structurally embeds electromagnetic propagation characteristics into the neural architecture. Built on a single residual UNet bac...

Yue Ruan, Xiao-Xiao Cheng, Yu-Nan Zhu et al. · 0 citations
#machine learning Preprint Open access Oct 2026

CktHGVAE: A Symmetric Design/State Heterogeneous Graph Variational Autoencoder for Transistor-level Analog/Mixed-signal Circuit Design and Analysis

We propose CktHGVAE, a heterogeneous graph variational autoencoder for transistor-level analog/mixedsignal CMOS circuits that takes not only design variables but also state variables as its inputs and outputs. With a single hyperparameter configuration without topology-specific tuning, comparison between model-generate...

Shigeyasu Uno · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.