Skip to content

Category

machine learning

17,191 papers

#artificial intelligence Preprint Oct 2026

Learning to Steer LLM Agents and Multi-Agent Systems

This work proposes a steering agent that supervises execution on the fly and steers the system back on track when drift occurs, and jointly train the two paths with reinforcement learning, combining a pairwise ranking objective with group-relative policy optimization (GRPO).

Le-Yang Shen, Ya-Xin Gong, Yang Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Knowledge That Is Linear Before Fine-Tuning Generalizes After It

Not all facts a language model can recall support further learning equally well. We distinguish active facts, which support generalization beyond their own recall, from inert facts, which can be recalled but do not support such generalization in a given task. We study this distinction by constructing new relations from...

Faridoun Mehri, Hinrich Sch\"utze · 0 citations
#artificial intelligence Preprint Oct 2026

Towards Continual Learning: Mitigating Forgetting With Subspace Tuning

Large language models (LLMs) acquire new skills through fine-tuning, but it can destroy capabilities they already have: catastrophic forgetting remains a central obstacle to continual learning in LLMs. Recent works connect forgetting to how far, and along which directions, fine-tuning moves the weights. On-policy metho...

Arnav Chavan, Kusha Sareen, Rishabh Tiwari et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Librarian Agents: Training LLMs to Curate Long-Context Workspaces that Anticipate Future Queries

Reasoning over long document contexts remains a challenge for large language models (LLMs). Standard retrieval methods are inherently reactive, bottlenecking agents with complex, cross-document reasoning at inference time, while precomputed structures like knowledge graphs often fall short because they rely on rigid he...

Anikait Singh, Teresa Zhang, Yoonho Lee et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Language Is a Security Surface for Agent Guards

This work builds LinguaGuardBench from the 1,220 labelled steps of TS-Bench AgentDojo-Traj, translating only the user instruction into German, French, Turkish, Swahili and Amharic, and keeps every tool call, observation and label byte-identical, so any change in a verdict is attributable to language alone.

Hasan Demirkiran, Jens Ernstberger · 0 citations
#artificial intelligence Preprint Oct 2026

Training-Free On-Policy Distillation

On-policy distillation consolidates specialist models into one student at the price of rollouts, teacher passes and gradient steps for every teacher. We show that the consolidation does not need training: with forward passes only, the capabilities of separately tuned specialists can be aggregated into one model that is...

Bang Yang, Jia-Jun Fan, Zhao-Yu Zhu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents

Real desktop automation is neither purely visual nor purely programmatic. Agents must understand user-facing interfaces while efficiently manipulating files, scripts, and system state. However, native GUI/code coordination cannot be obtained by prompt-level tool composition. In our preliminary experiments, naively addi...

Bowen Yang, K. Jin, Zichen Ding et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Beyond Downstream QA: Rethinking How We Evaluate Agent Memory

Agent memory benchmarks evaluate whether an agent's responses reflect correct knowledge, measuring downstream question-answering accuracy as a proxy for memory quality. We show this evaluation paradigm is incomplete: it conflates memory correctness with retrieval and generation quality, producing both false positives w...

Sebastian-Antonio Toma, Jean de Kernier, Mike Ply et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Whole-Body Dexterity

Current humanoid dexterous manipulation remains largely confined to end-effectors and simple grasps, falling short of humans'ability to engage the entire body by bracing and sliding bulky objects against the arms and torso. We introduce Whole-Body Dexterity (WBD), a general framework that uses the robot's body and appe...

Conor Mc Gartoll, An Dang, Pranay Thangeda et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Mosaic: Multi-Session Agentic Reinforcement Learning

Most existing agentic reinforcement learning methods assume single-session trajectories, where interaction proceeds within one continuously accumulated context. However, agentic techniques such as context compaction and subagent forking may produce trajectories spanning multiple sessions, creating a mismatch between th...

Yilong Xu, Minrui Xu, Xinyu Zhou et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Specification Gaming and a Constrained Reinforcement Learning Mitigation in a Cleaning Gridworld

Reinforcement learning agents optimize exactly the reward signal they are given, which can diverge sharply from an intended true objective when that signal is only a proxy for it; this failure mode is known as specification gaming. Existing evidence for this failure mode is largely observational, with comparatively few...

Hilda Adwubi Osei · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.