Skip to content

Category

machine learning

18,068 papers

#artificial intelligence Preprint Open access Oct 2026

A Stronger Teacher Within: Strengthening MoE Models via On-Policy Bidirectional Distillation

Reinforcement Learning with Verifiable Rewards (RLVR) has substantially improved Mixture-of-Experts (MoE) LLMs, but its outcome-level rewards provide only sparse supervision. On-Policy Distillation offers dense token-level feedback, yet requires a stronger compatible teacher, while on-policy self-distillation relies on...

Haoyu Chen, Jun Bai, Yang Liu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Tree-Aware Posterior Distillation for Long-Horizon Agentic Reinforcement Learning

Reinforcement learning with verifiable rewards has become a scalable post-training paradigm for large language models. However, training agents over long-horizon interactions presents two challenges: using only terminal rewards makes turn-level credit assignment sparse and high-variance, while sequential mini-batch upd...

Heming Zou, Qi Wang, Yi-Xiu Mao et al. · 2 citations
#machine learning Preprint Open access Oct 2026

Structural Affinity: An Algorithm for Coherent Cage-Based Shape Design

Cage-based deformation (CBD) parametrises 3D geometry through a small set of control handles, effectively enabling a variety of tasks from animation and interactive modelling to tool-based co-design, neural deformation transfer, and aerodynamic shape optimization. Many optimization approaches relying on CBD employ regu...

Aviraj Newatia, Shengan Yang, Hantao Zhong et al. · 0 citations
#machine learning Preprint Oct 2026

Nearly Linear Private Learning of Littlestone Classes

Differentially private learning aims to learn from data while protecting individual training examples. For binary classification, finite Littlestone dimension characterizes approximate private PAC learnability (Alon et al., JACM 2022). Understanding how this dimension controls private sample complexity remains a centra...

S. Moran, Chao Yan · 0 citations
#machine learning Preprint Oct 2026

Grounded Credit Assignment in Reinforcement Learning for Multi-Turn Search Agents

Outcome-reward reinforcement learning such as GRPO gives every token of a search-agent rollout the same advantage, although the rollout exercises two capabilities: finding evidence and using it. We show that accuracy improves without grounding: Search-R1 raises accuracy on all seven QA benchmarks, yet on Bamboogle the...

Qi-Rui Liu, Hao Chen, Yi Wen et al. · 1 citation
#artificial intelligence Preprint Oct 2026

Local proxies for memory-efficient training

Local learning algorithms can reshape resource requirements of artificial intelligence. The memory bottleneck of standard end-to-end backpropagation lies in the need to store all network activations until the loss gradient has been propagated back through. Local learning avoids this, but typically at a cost in accuracy...

Wu-Zi S. Han, Brian A. Yuan, G. Bellec · 0 citations
#machine learning Preprint Open access Oct 2026

MetaCurate: Evolving Curation Filters for High-Quality Agentic Coding Data

Supervised fine-tuning on agent trajectories is an effective way to improve coding agents, but selecting useful training examples requires more than identifying successful runs. A resolved patch may follow inefficient reasoning or unnecessary tool use, while a failed run may still contain useful intermediate steps. Tra...

Donghoon Kim, Seunghyuk Oh, Kevin Galim et al. · 0 citations
#machine learning Preprint Oct 2026

LED: Improving Masked Diffusion Language Models by Lookahead Editing

This design introduces a rewritable proposal that uses additional compute to improve expressivity while keeping the simple mask-based transition schedule of MDMs, and fine-tune Qwen2.5-7B and Qwen3-8B to obtain LED-\texttt{7B} and LED-\texttt{8B}, respectively.

Yu-Yan Zhou, Ze-Yuan Yang, Yuxuan Song et al. · 0 citations
#machine learning Preprint Oct 2026

Domain-specific language alignment of multimodal embeddings towards explainable predictions

Multimodal data are commonly fused into latent representations that improve downstream task performance but are not interpretable, limiting their application in domains that require explainable model decisions. Vision-language alignment has made image embeddings interpretable through language, but requires vast image-c...

Gabriele Tijunaityte, T. L. van der Plas, M. Belaid et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Towards a GraphNARX model for structural dynamics

The current paper introduces the GraphNARX model, a graph-based nonlinear autoregressive exogenous model for structural dynamics. The model is built to account for the geometry of structures and to model dynamic behaviour as the interaction between elements of the structure. Similar to other types of NARX models, Graph...

George Tsialiamanis, Keith Worden · 0 citations
#machine learning Preprint Open access Oct 2026

Where Latents Belong and How They Flow: Joint Identification of Structural Roles

Latent factors in dynamical systems can play different roles across observations and time. For example, an idea in a group meeting may be expressed by only some participants, inherit information from earlier discussions, and shape what is said next. We formalize this notion as the structural role of a latent factor, de...

Xintong Li, Kun Zhang, Yujia Zheng · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.