Skip to content
Preprint

Knowing When Not to Reuse: Conditional Experience Transfer in Autonomous LLM Post-Training

Aug 2026 · 0 citations · 25 references
Computer Science

TL;DR

Conditional experience transfer is formulated as conditional experience transfer and Boundary-Calibrated Intervention Transfer is introduced, a method that authorizes experience reuse before weight-changing training and attains higher equal-budget final-model quality than the evaluated alternatives.

Abstract

Large language models offer broad capabilities, but adapting them to evolving domains, tools, and requirements often entails repeated post-training. Autonomous systems automate parts of this process by proposing updates, training candidates, and using evaluation feedback to select subsequent proposals. As evidence accumulates, a central problem emerges: which past update evidence remains actionable after subsequent training has changed the parent model? An update's effect depends on its parent, data, and training stage. Treating past success as context-free permission can waste compute. If the resulting child is promoted, it can also degrade the subsequent training trajectory. We formulate this problem as conditional experience transfer and introduce Boundary-Calibrated Intervention Transfer (BCIT), a method that authorizes experience reuse before weight-changing training. BCIT binds an observed effect to its source context, checks applicability conditions, vetoes candidates with named hard conflicts, and obtains current-state evidence through a bounded training trial when needed. Fully trained candidates still face a shared adoption rule, and only observed events extend memory. On one 4B model adapted across finance reasoning, text-to-SQL, and function calling, candidate updates exhibit heterogeneous target and retention effects across the evaluated contexts. Under matched candidates, evidence, and compute, BCIT authorizes fewer harmful updates and attains higher equal-budget final-model quality than the evaluated alternatives. These results support treating experience authorization as a distinct problem in autonomous post-training.

View source

Similar papers

#artificial intelligence Review Aug 2026

What is Missing from AI Post-Training AI: An Empirical Analysis

Analyzing a large corpus of publicly released post-training trajectories, it is found that across different tasks, the agent's training strategy is locked in at the very beginning, and the entire remaining budget is spent on local adjustments within the selected strategy.

J. Lim, Xin Huang, Hao Peng et al. · 2 citations · ⚡1
#natural language process... Preprint Sep 2026

Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents

Autonomous agents powered by large language models (LLMs) continuously accumulate experience through interaction, creating an opportunity to improve future behavior through self-evolution. A fundamental challenge is how to transform abundant, task-specific interaction experience into reusable model competence without s...

Wen-Bo Gao, Zhao-Mou Song, Zhi-Yuan Ji et al. · 0 citations
Preprint Aug 2026

SkillCommit: Evolving Agent Skills through Behaviorally Validated Scope Expansion

SkillCommit is an online skill evolution framework that continuously transforms experience into a hierarchical library of reusable skills, enabling cross-model experience transfer and consistently improves agent performance across diverse domains.

Yu He, Wei-Kai Yang · 4 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.