Hugging Face researchers have introduced SkillEvo, a novel framework designed to sustain the evolution of AI agent skills through multi-turn interaction feedback and active governance. Traditional agent skills are either hand-crafted or generated in a single LLM pass, lacking a closed loop for improvement based on real interaction failures. Recent attempts close this loop but rely on single-turn question-answering evaluation, leading to a decay in evolution gradients after the first round of patches.
SkillEvo addresses this by recasting multi-turn user simulation from an evaluation endpoint into a feedback generator. Follow-up questions expose defects layer by layer, ensuring that each revision round consumes and produces new feedback, thereby maintaining a trustworthy evolution gradient. The second component replaces passive scalar-gate rejection with an independent governance layer that actively repairs factual degradation and structural bloat, preventing gradient drift.
In experiments across six categories of cloud services, nine production skills, and 98 skill-reference files, SkillEvo outperformed self-reflection-based evolution by 23.0 points and single-turn-QA-driven evolution by 15.4 points. This demonstrates the effectiveness of sustained feedback and governance in driving continuous skill improvement.