Skip to content

Category

machine learning

18,068 papers

#machine learning Preprint Oct 2026

SPROUT: Scaling Agentic Reinforcement Learning for Long-Horizon Software Engineering

Reinforcement learning (RL) has driven substantial progress in coding agents by relying on verified successful trajectories as learning signals. However, such trajectories are scarce in long-horizon software engineering tasks, where a minor error can invalidate the entire rollout. Repeatedly restarting from the initial...

Mengyang Liu, Wei-Ming Wang, Hai-Xin Nan et al. · 1 citation
#machine learning Preprint Oct 2026

Understanding and Mitigating Training Instability in Large-Scale Recommender Systems: A Cascade Perspective

Training large-scale recommender systems on dynamic industrial platforms, such as Short-Form Video (SFV) services with billions of daily interactions, faces critical stability challenges. Rapid distribution shifts in user data and increasing model complexity frequently trigger a divergence cascade, typically initiating...

Yue-Ning Li, Ze-Yu Wang, Zhen Zhang et al. · 0 citations
#machine learning Preprint Oct 2026

Decomposing A Neural Learner

Neural learners for classification and regression are often criticized as black boxes. We propose a probabilistic decomposition of neural learners that accounts for heterogeneous predictability across the feature space. A training procedure combining the EM algorithm, stochastic gradient descent, and maximum likelihood...

Z. Bi · 0 citations
#machine learning Preprint Oct 2026

STREGO: A Scalable Implementation of a Trust-Region Framework for Noisy Bayesian Optimization

TREGO, a trust-region Bayesian optimization (BO) method for expensive blackbox problems, has convergence guarantees, but only for exact function values. In high dimension, its performance tends to deteriorate. This paper asks whether a trust-region BO method can be extended to handle noisy evaluations while being compe...

Youssef Diouane, I. El Hallaoui, Meisseme Kadri et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Diagnosing Generalization Boundaries in AI-Based Vulnerability Detection via Calibrated Embedding Distances

High benchmark scores in learning-based vulnerability detection mask severe degradation under distribution shifts. This paper demonstrates that calibrated embedding geometry exposes these hidden generalization boundaries on syntactically similar vulnerable and patched code pairs. An evaluation of CodeBERT and Qwen2.5-C...

Konstantin Ievtushenko, Ralf L\"ammel, Jan J\"urjens · 0 citations
#machine learning Preprint Oct 2026

Learning to Sync at the Edge: Client-Side Adaptive Synchronization for Federated Learning

The scalability and performance of edge federated learning are fundamentally constrained by synchronization bottlenecks. Clients operate under heterogeneous compute, time-varying communication conditions, and, in some settings, privacy constraints, yet synchronization is often still handled with fixed schedules. Howeve...

Ebasa Temesgen, Ammar Ahmed, N. Lechamo et al. · 0 citations
#machine learning Preprint Open access Oct 2026

BigCell: Generating Gigapixel Whole-Slide Images

Whole-slide images (WSIs) are gigapixel-scale digital scans of histopathology tissue and serve as the primary basis for cancer diagnosis. Existing histopathology generative models operate at the patch scale, producing fixed-size tiles of at most 1024$\times$1024 pixels which encompass only a small fraction of the WSI....

Srikar Yellapragada, Alexandros Graikos, Zilinghan Li et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Token-Budgeted Candidate Retrieval for 3D Scene-Grounded VLMs: Category Names vs. Pairwise Geometry

Under a fixed context budget, which objects and relations should a 3D scene-grounded VLM see first? On ScanNet indoor referring benchmarks (Dai et al., 2017), matching the query to object category names outperforms pairwise geometry scoring at every reported K. The gaps are largest at high recall. Analytic pairwise cue...

Micha{\l} Zakrzewski, Mariia Shpir, Taras Rumezhak · 0 citations
#machine learning Preprint Oct 2026

Simple Linear Corrections for Compression in Late Interaction

Late-interaction (multi-vector) models represent documents using a set of token-level vectors, providing a middle ground between cross-encoders and dense encoders in terms of quality and cost of embedding. However, compared to the latter, the indices are costly to store and score. Pooling and pruning based compression...

Mihir Agarwal, Sabyasachi Basu, Viraj Agrawal · 0 citations
#machine learning Preprint Open access Oct 2026

AutoEnvScaling: Automating the Data Flywheel with Terminal Agents

Terminal agents solve tasks in software engineering and scientific research by executing commands in a terminal. Training them via reinforcement learning (RL) requires diverse and verifiable environments, but these environments are still mostly designed by human researchers, so their supply grows only as fast as resear...

Simon Yu, Baolin Peng, Bo Liu et al. · 0 citations
#machine learning Preprint Oct 2026

A Stochastic Analysis Perspective on Diffusion Models

Generative modelling involves two complementary tasks: learning a probabilistic approximation of an unknown data distribution from observations, and designing a tractable mechanism for sampling from this approximation. We present a stochastic-analysis perspective on score-based generative models, connecting ideas from...

SU StanislasStrasman, Lpsm · 0 citations
#machine learning Preprint Open access Oct 2026

On physical implementability of reinforcement-learning-driven reasoning

In the machine learning community, the reinforcement-learning-driven reasoning process has been intensively studied since around 2025. In this article, we present a negative result on the hardware implementation of this reinforcement-learning-driven reasoning process in a physical neural network model in the presence o...

Eiji Konishi · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.