Skip to content
Preprint

When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systems

Aug 2026 · 1 citation · ⚡ 1 influential · 24 references
Computer Science

TL;DR

PoisonedEvolution is introduced, a trajectory-poisoning attack on self-evolving skill systems that exposes evidence promotion as a security boundary for self-evolving agents.

Abstract

Self-evolving skill (SES) systems distill agent trajectories into persistent skills, allowing untrusted experience to become trusted instruction. We introduce PoisonedEvolution, a trajectory-poisoning attack on this promotion process. Our skill-visible black-box attacker can inspect a target skill and contribute bounded evidence, but cannot observe private pools or evolution logic or edit the skill bank. Artifact poisoning requires Inclusion, Evolution Attribution, and Realization. Attribution is the distinctive bottleneck: the target behavior must appear causally useful, recurrent, and generalizable before promotion. We evaluate four representative security-effect families using inert canary specifications. At 10% attacker support, across six mainstream LLM evolvers in SkillClaw, PoisonedEvolution embeds target behaviors in 546/600 trials (91.0% SER). On the structurally different Trace2Skill pipeline at the same ratio, it embeds target behaviors in 369/600 trials (61.5% SER), demonstrating transfer across evolution architectures. In a representative controlled study, three consistent attacker records suffice in a 30-record batch, whereas a single record is much weaker. Ablations identify recurring support, causal framing, and domain-aligned encoding as the main determinants of success. These findings expose evidence promotion as a security boundary for self-evolving agents.

View source

Similar papers

Preprint Aug 2026

Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents

This work proposes SafeEvolve, which checks each skill when it is written and when a later task retrieves it, and introduces SkillMisevo-Gym, which clears every task session but keeps the skill library, so each of these steps can be checked separately.

Xutao Mao, Liang Zhao, Xiang Zheng et al. · 3 citations · ⚡1
Preprint Aug 2026

Query-Only Backdoor Attacks on Self-Evolving Skills via Trajectory Poisoning

Agentic skills improve large language model (LLM) agents by encoding reusable procedures for complex tasks. However, manually authored skills often adapt poorly to long-horizon tasks and changing environments. To address the limitation, self-evolving skill systems have been developed to automatically construct and upda...

Yuyang Luo, Haoran Wang, Kai Shu · 0 citations
#artificial intelligence Preprint Sep 2026

SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents

This work introduces SEABench, a benchmark for studying endogenous misalignment arising from agent self-evolution, with 48 longitudinal task sequences that span multiple evolution surfaces, task domains, and harm types in a rich personal-assistant environment and shows that qualitatively different safety behaviors emer...

Saswat Das, Parvati Viswanathan, Daniel Donnelly et al. · 1 citation
#artificial intelligence Preprint Sep 2026

HarnessEvolve: Learning from Reference Trajectories for Reliable Agent Self-Evolution

This paper introduces HarnessEvolve, a self-evolving framework that learns from reference trajectories to achieve reliable agent self-evolution, and overcomes credit assignment failure by generating reference trajectories and aligning failed executions against them to extract error signals.

Wen Jiang, Ming-Min Chu, Yiding Tian et al. · 14 citations
Preprint Aug 2026

ActBench: Self-Evolving Benchmark of Behavioral Safety in Cowork Agents

This work defines behavioral safety and introduces ActBench, a self-evolving benchmark that evaluates such behavior risk from execution trajectories rather than final responses, and proposes a dual evidence verification mechanism that verifies agent execution safety and utility through log evidence and LLM-based trajec...

H. Yao, Yimin Liu, Meihui Chen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.