[skill-optimizer] Daily Skill Optimizer Improvements - 2026-08-03

[github-actions]

Summary

• Run mode: dry-run
• Status: ⚠️ (no actual grading occurred)

Key Findings

1. Enable real suite execution by provisioning OPENROUTER_API_KEY for this workflow. Expected impact: unlocks actual grading of the 3 existing cases (ansi-escape-prevention, sanitized-outputs-migration, skill-optimizer-clean-git) instead of a no-op dry-run every day, turning the workflow into a genuine quality signal rather than a log-only exercise.
2. Expand .skill-optimizer/suite.yml beyond its current 3 cases to cover more of the root SKILL.md routing table (e.g. a case testing routing to developer-security for template-injection questions, and one testing routing to developer-internals for compiler/safe-outputs questions). Expected impact: broader coverage catches skill-routing regressions in areas beyond ANSI-escape and sanitized-outputs guidance, which are the only two currently graded.
3. Add Docker availability as a documented prerequisite/checked precondition in daily-skill-optimizer.md, with a clear failure/warning path (e.g. explicit step summary note) when Docker is present but OPENROUTER_API_KEY is missing, rather than silently degrading to dry-run. Expected impact: makes the recurring "skipped suite execution" condition visible to maintainers so they can decide to add the secret or intentionally keep dry-run mode, instead of it going unnoticed in run.log.

Evidence from Artifact

• summary.json: {"repository":"github/gh-aw","run_mode":"dry-run","run_status":0,"run_url":"https://github.com/github/gh-aw/actions/runs/30782767895"}
• run.log: dry-run: Docker available but OPENROUTER_API_KEY not set; skipping suite execution — confirms Docker was available but the run bailed on missing the API key, so no grading of .skill-optimizer/suite.yml occurred.
• .skill-optimizer/suite.yml currently defines exactly 3 cases: ansi-escape-prevention, sanitized-outputs-migration, skill-optimizer-clean-git, all targeting the root SKILL.md prompt surface (skill-optimizer.json: "skill": "../SKILL.md").
• npm-ci.log / npm-build.log show the fastxyz/skill-optimizer tool cloned and built successfully (362 packages installed, tsc build succeeded), so the toolchain itself is healthy — the gap is purely in credential/config, not tooling.

Recommendations

1. Add OPENROUTER_API_KEY as a repository/organization secret and wire it into .github/workflows/daily-skill-optimizer.md's env: block so run-suite executes for real instead of dry-running daily.
2. Add 2+ new cases to .skill-optimizer/suite.yml targeting under-tested skill-routing areas (e.g. developer-security, developer-internals) to widen coverage of the root SKILL.md routing table.
3. Add an explicit warning/step-summary annotation in the workflow when Docker is available but OPENROUTER_API_KEY is missing, so silent dry-run skips are surfaced to maintainers instead of only appearing in run.log.

Generated by ⚡ Daily Skill Optimizer Improvements · auto · 20.6 AIC · ⌖ 2.36 AIC · ⊞ 6.3K · ◷

• expires on Aug 9, 2026, 7:56 PM UTC-08:00