Skip to content
Preprint

An Empirical Study of Downstream Adaptation for Agent Skills

Jul 2026 · 0 citations · 38 references
Computer Science

TL;DR

A reuse paradox is revealed: although skills are intended to be easily imported and reused, developers spend a lot of effort rewriting what the skills do, fixing skill discoverability, and translating them for different tools and languages, indicating a need for better abstractions, standardized interfaces, and automated support for skill adaptation.

Abstract

As Large Language Model (LLM) agents become integral to modern software systems, ``skills''have emerged as a novel unit of software reuse, enabling developers to package workflows, decision procedures, and prompt-based policies. While skills are intended for reuse, downstream developers frequently modify published skills to fit local contexts, yet little is known about the nature of such adaptations. This paper presents the first empirical study of downstream skill adaptation in public forks, to understand how published skills are adapted, and to provide implications for researchers and engineers on improving skill design, evolution, and orchestration. Specifically, we analyze 1,126 skill-adaptation instances from six widely adopted skill repositories and develop a taxonomy comprising 46 adaptation patterns organized into 13 families. Our key findings reveal a reuse paradox: although skills are intended to be easily imported and reused, developers spend a lot of effort rewriting what the skills do, fixing skill discoverability, and translating them for different tools and languages, indicating a need for better abstractions, standardized interfaces, and automated support for skill adaptation. Furthermore, adaptations are highly interdependent, with changes in one component often requiring coordinated updates elsewhere, motivating automated support for detecting inconsistent modifications. We also find that nearly one-fifth of adaptations introduce security-sensitive content within the same instruction text that governs behavior.

View source

Similar papers

Jul 2026

Inside the Skill Market: From Software Engineering Activities to Reusable Agent Skills

The first large-scale empirical study of SE skills in public repositories and marketplaces provides the first activity-centric characterization of SE skills and reveals how SE activities are increasingly being transformed into reusable skills.

Jia-Lun Cao, Xinru Yan, Song-Qiang Chen et al. · 1 citation
Preprint Aug 2026

Do Personalized Skills Help Coding Agents? An Empirical Study of Developer Interaction Histories

This work proposes a framework for extracting reusable developer preferences from interaction traces, generates personalized skills through rule-based bootstrapping and evidence-grounded refinement, and evaluates them using a reproducible replay framework with an interactive, trajectory-conditioned LLM-based human deve...

Shuyan Huang, Kai Du, Andrew S. Lan · 3 citations · ⚡2
Review Jul 2026

Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries

A taxonomy-driven survey asks how dynamic skill libraries change over time in large language model agents, and synthesizes dynamic skill systems as lifecycle-managed, verified, evolving artifact stores.

Yubo Li · 2 citations
Jul 2026

Authoring Agent Skills: A Software-Engineering Approach

This note argues that a skill is a software artefact and that its construction should follow software-engineering principles, with qualifications: single responsibility, separation of interface from implementation, low coupling, and economy in a shared token budget, together with behavioural evaluation in place of dete...

Giuseppe Destefanis · 1 citation
Book Open access Aug 2026

Recipes for Agents: Understanding Skills and Their Open Questions

This paper examines how skills may help address bottlenecks of current agents and how they may expand agent capabilities through reusable domain procedures loaded at inference time and outlines open questions in skill construction, composition, evaluation, portability, governance, and security.

Hanwen Xing, Haomin Zhuang, Xuandong Zhao et al. · 7 citations · ⚡1
Review Open access 2026

How Experienced Developers Can Get More Value from Agents

AI agents are becoming a fundamental part of modern software creation, helping developers in generating code, debugging, designing systems, etc. But there is a clear difference between how beginners and experienced software engineers get benefits from these tools. Newbies usually depend on agents for one-time prompts a...

Madhurima Kommuru, Srujana Pulipaka · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.