Skip to content

Category

machine learning

18,068 papers

#machine learning Preprint Oct 2026

$L_0$ Feature Selection via Monte Carlo Tree Search in High-Dimensional Financial Regression

Feature selection is a central problem in high-dimensional financial regression, where large numbers of engineered variables and strong correlations among predictors reduce model stability and interpretability. $L_1$ regularization (Lasso) is widely used for sparse regression, but its shrinkage can be restrictive when...

Cameron Mouangue, Tristan Cazenave · 0 citations
#machine learning Preprint Open access Oct 2026

Simultaneous Competitive and Regret Guarantees for TCP Acknowledgment

We study simultaneous competitive and regret guarantees for TCP acknowledgment. Each acknowledgment serves all pending packets, and the objective is to minimize the total acknowledgment and waiting costs. It is well known that no deterministic online algorithm achieves a competitive ratio better than $2$. Given $k$ ran...

Tsubasa Harada, Yasushi Kawase, Hanna Sumita · 0 citations
#machine learning Preprint Open access Oct 2026

Rationally Linearized MLPs

We present Rationally Linearized Multilayer Perceptrons(RaLiMPs), a new approach to efficiently linearizing MLPs using low-degree rational approximations of standard activation functions. Inspired by polynomial-based MLP linearization, we show that rational approximations can provide accurate representations at substan...

Arijit Sehanobish, Byeongchan Kim, Avinava Dubey et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Probabilistic Ship Trajectory Forecasting using Transformer Models on AIS Data

Anticipation of vessel trajectories is an essential task when navigating at sea. This applies to both human navigators and autonomous surface vessels. Trajectory forecasting enables sub-routines such as collision avoidance to assess the situation and react accordingly in time. This paper investigates Transformer and Pe...

Frederik E. T. Sch\"oller · 0 citations
#machine learning Preprint Open access Oct 2026

Simulating Training Spikes of Deep Neural Networks by Layer-wise Random Feature Models

Intermittent ``spikes'' in loss, during the pre-training of Large Language Models (LLMs), remains a mysterious phenomenon both theoretically and empirically. In this paper, we show that simple quadratic models with heavy-tailed, power-law distributed inputs can replicate these spikes. We introduce a theoretical framewo...

Ran Tian, Courtney Paquette · 0 citations
#machine learning Preprint Oct 2026

FedPCD: Priority-Constrained Federated Aggregation

FedPCD is proposed, a priority-constrained federated optimization framework that separates the global optimization objective from client protection, and preserves the conventional federated aggregate as the primary objective, while allowing only the minimum correction necessary to meet client performance constraints.

Yousef Irshaid, Dara Varam, Mohamed I. Alhajri · 0 citations
#machine learning Preprint Open access Oct 2026

PPG-Bench: A Unified Benchmark for PPG Foundation Models

Photoplethysmography (PPG) is increasingly recorded by wearable and clinical devices at enormous scale, and a growing number of PPG foundation models (FMs) have been developed to compute reusable representations for various downstream tasks. These models are difficult to compare: different evaluations use different dat...

Arvasu Kulkarni, Mahir Jain, Aditya Ray Mishra et al. · 0 citations
#machine learning Preprint Oct 2026

Accelerating Linear Bandits with Persistent Candidate Sets

Exhaustive optimistic scoring can make action selection costly in linear bandits with a large fixed set of $K$ actions, requiring $\mathcal{O}(K)$ score evaluations per round. We introduce Persistent Candidate LinUCB (\textsc{PC-LinUCB}), which maintains $k$ active actions and samples $q$ challengers uniformly from the...

Bing-Kui Tong, Daria Korovaitceva, M. Sheshukova et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Why Linear Models Can Still Work in a Complex and Changing World

Linear models can predict well in complex domains even when underlying mechanisms are nonlinear. We argue that this can occur because the complexity of the world exceeds the complexity that can be learned reliably from finite, partially observed data. Flexible models can exploit curvature, thresholds, and interactions...

Fangzhou Lin, Dengzhe Hou, Yinxing Li et al. · 0 citations
#machine learning Preprint Oct 2026

PlacePulse: Learning Transferable Place Representations from Structural Geographic Data

This work introduces PlacePulse, a structural geospatial foundation model that compresses 572 attributes, expanded to 2,288 inputs through H3 neighborhood aggregates, into 256-dimensional unit-norm embeddings for 1,055,537 H3 resolution-7 cells in the United States, and introduces a reusable two-axis benchmark that sep...

Lucía García-Duarte, M. Álvarez, D. Vicente et al. · 0 citations
#machine learning Preprint Open access Oct 2026

BLOKS: Scaling Kernel Solvers with Sketched Block Preconditioning

Kernel Ridge Regression (KRR) is a theoretically sound algorithm for nonparametric learning, which is also often used to investigate properties of deep learning. However, the exact KRR formulation incurs time and memory costs preventing applicability to large datasets, motivating the development of approximate solvers....

Giordano Vitale, Giacomo Meanti, Marco Rando et al. · 0 citations
#machine learning Preprint Oct 2026

Opening the Black Box of Classifier-Free Guidance via Information Bottleneck

Classifier-free guidance (CFG) is a standard technique for improving conditional generation in diffusion models, yet its activation schedule is usually selected heuristically. In practice, most existing CFG-based methods rely on a pre-defined activation policy throughout inference, while recent dynamic variants often d...

Jia-Yang Gao, Tian-Yi Zheng, Jia-Yang Zou et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.