SkillOpt: Executive Strategy for Self-Evolving Agent Skills

arXiv:2605.23904 — Microsoft Research Asia, SJTU, Tongji, Fudan (May 2026).

Abstract summary

Agent skills today are hand-crafted, one-shot generated, or loosely self-revised — none behave like reproducible deep-learning optimizers. SkillOpt is the first systematic controllable text-space optimizer for agent skills: a separate optimizer model converts scored rollouts into bounded add/delete/replace edits on a single skill document, accepting edits only when held-out validation strictly improves.

Methodology

• Frozen target agent; skill document as external trainable state
• Textual learning-rate budget, rejected-edit buffer, epoch-wise slow/meta update
• Zero inference-time model calls at deployment
• Evaluated across 6 benchmarks, 7 target models, 3 harnesses (direct chat, Codex, Claude Code)

Results

• Best or tied on all 52 (model, benchmark, harness) cells
• Beats human, one-shot LLM, Trace2Skill, TextGrad, GEPA, and EvoSkill baselines by +5.4 points average
• GPT-5.5 gains: +23.5 (direct chat), +24.8 (Codex loop), +19.1 (Claude Code)
• SpreadsheetBench: 41.8% → 80.7% with SkillOpt on GPT-5.5
• Skills transfer across model scales, harnesses, and nearby benchmarks

Practical implications

Compact deployable artifacts (300–2,000 tokens) enable enterprise skill engineering without fine-tuning infrastructure. Community training via GBrain averages $1–5 per single-task skill.

Code

https://aka.ms/SkillOpt (github.com/microsoft/SkillOpt) — MIT license.