Skip to content

Category

machine learning

18,068 papers

#machine learning Preprint Open access Oct 2026

The Tilted Sampling Problem: Optimism, Posterior Sampling, and Logarithmic Regret

Many modern learning systems are used not to select a single best action, but to sample diverse high-quality outputs. Examples include entropy-regularized reinforcement learning, RLHF, and reward-guided generative modeling. Motivated by these settings, we study tilted sampling: an online learning problem in which the g...

Mohammad Pedramfar, Siamak Ravanbakhsh · 0 citations
#machine learning Preprint Open access Oct 2026

Self-Calibrated Subspace Robust PCA for Parameter-Free Removal of Mixed Noise and Line Stripes in Hyperspectral Images

Hyperspectral images (HSIs) are often corrupted by Gaussian noise, impulses and stripes whose intensities vary across bands. The representative coefficient correlated total variation (RCCTV) model restores HSIs efficiently, but it lacks Gaussian and stripe terms, and its noise-aware extensions require the noise level a...

Wenzhe Wang · 0 citations
#machine learning Preprint Oct 2026

Graph Dirichlet Energy for Fitting-Free Bivariate Causal Inference

We propose the Graph Dirichlet Energy Causal Inference (GDECI) criterion for distinguishing cause from effect in bivariate settings. For a candidate direction $X\to Y$, we construct a kernel similarity graph from $X$ and treat $Y$ as a graph signal. The score is the Dirichlet energy of this signal, induced by the unnor...

P. Daniušis · 0 citations
#machine learning Preprint Open access Oct 2026

Learning Lean Feedback for Efficient Proof-Candidate Evaluation on GPUs

Training language models for formal theorem proving requires large numbers of verifier calls. Slow checks and timeouts often leave GPUs waiting and withhold rewards from potentially correct proofs. We train neural evaluators to predict Lean 4 verdicts and compiler feedback on GPUs using 4.84M labelled programs. We comp...

Lazar Milikic, Etienne Bamas, Emmanuel Abbe et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Lethe: Link Inference Attacks For Evaluation of Edge Unlearning Methods

Graph Unlearning (GU) aims to remove the influence of specific training data from a Graph Neural Network without retraining anew. While most methods address removal of nodes and features, Edge Unlearning (EU), aiming at forgetting edges, has recently attracted dedicated attention as a standalone problem due to the hard...

Andrea D'Angelo, Francesco Gullo, Davide Mottin et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Physics-Aware Distillation of a Grid Foundation Model for Real-Time Edge Inference

Grid foundation models (GridFMs) are graph transformers pretrained on a masked power-flow objective, and evaluate power flow orders of magnitude faster than an iterative solver. Their size, however, targets data-centre inference, whereas low-inertia operation increasingly asks for inference at the edge, next to the mea...

Vlad Alexandru S\u{a}nduleac, Shahariya Rasheed Rayamarakkarveettil Puthanpurayil, Noman Khan et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Local Epochs as Optimal Stopping: Theory and Evidence in Federated Learning

How long should each client train before communicating? Federated learning usually answers with a fixed, hand-tuned number of local epochs, yet an extra epoch helps only while the loss it removes outweighs the client drift it adds. We cast local training as finite-horizon optimal stopping: a client trains while the nex...

Ke Xiao, Qiyuan Wang, Christos Anagnostopoulos · 0 citations
#machine learning Preprint Open access Oct 2026

A Closed Form Depth-Width Law for Neural Collapse in Deep Linear Networks

How depth and width of neural networks shape learned representations is usually studied only after training. We show that, in a tractable feature-learning setting, this dependence can instead be obtained in closed form. Using neural collapse as a probe of representation geometry, we express NC1--NC3 directly in terms o...

Pankhil Gawade, Kirsten Fischer, Guy Wolf et al. · 0 citations
#machine learning Preprint Oct 2026

Measuring the local shape of learning-rate transfer curves

Understanding the learning-rate (LR) dependence of trained model performance is essential for better optimization of neural networks, but the appropriate size of the LR depends on learning dynamics, architecture, and their hidden biases, and thus our understanding of this complex dependence remains limited. The behavio...

Satoki Ishikawa, Rio Yokota, Ryo Karakida · 0 citations
#machine learning Preprint Oct 2026

N-Gram Memories at Two Bits: Quantizing Lookup Tables in Large Language Models

Conditional memory expands language-model capacity through selective lookup, but the full embedding table must remain available for every possible input. We introduce Conditional Program (CP), a compressed representation that reconstructs only the rows an input requests. CP represents each row by a short code and a loc...

Donghoon Han, Minseop Jung, Dongjin Kwak et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Q($\gamma_H$): Entropy-Guided Horizon Mixing in Multi-Discount Q-Learning

A fixed discount factor in Q-learning imposes a single planning horizon throughout training, despite the differing demands of early exploration and long-term credit assignment. We propose Q($\gamma_H$), a multi-horizon Q-learning framework that maintains multiple discount-specific heads and adaptively combines them at...

Arwa Albelaihi, Abdulrahman Altahhan · 0 citations
#machine learning Preprint Oct 2026

Pairwise AUC Optimization Needs Corrective Power: A Unified View

The authors' results provide a mechanistic explanation for several empirical patterns: squared-hinge loss is often an effective AUC surrogate; cross-entropy warm-up can help models that enter the AUC phase from a poor starting region; and parameter-efficient fine-tuning from a pretrained model can reduce that need by s...

Jia Chen, Zhi-Yong Yang, Shi-Long Bao et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.