Skip to content

Concise skills rollout: improvement (3 skills, 2 model-invoked) #6584

Description

@kyle-sexton

Part of #6476. Rewrite improvement's skills to the skill criteria in one draft PR, following the per-plugin runbook (/playbooks:skill-authoring, reference/rewrite-a-plugin.md). The runbook and the rewrite protocol it cites decide what ships; this issue holds only what is specific to the plugin.

The plugin today

As of origin/main on 2026-10-24:

  • Skills: find, improve (model-invoked); setup (user-invoked).
  • Outcome eval case directories under the plugin: 1. Probe files under probes/: 0.

Done when

  • /skill-quality:check plugins/improvement on the PR head reports no FAIL that the run on main does not.
  • /evals:validate passes on plugins/improvement's eval suite at the PR head.
  • Each model-invoked skill has a probe file: plugins/improvement/probes/find.json, plugins/improvement/probes/improve.json.
  • The PR body holds a per-skill decision table, description and body decided separately, with the before and after numbers behind each row.
  • The PR body names every skill or case left unmeasured, with the reason.
  • The plugin's version or changelog entry is in the PR, per the plugin's release mode.

Eval spend and review

  • Eval passes within prepaid API credit are pre-approved (owner decision Q46, 2026-10-24), at the --max-cost-usd 5 per-pass ceiling set on #6476 on 2026-10-18.
  • No person gates the PR: the owner's 2026-10-24 decision (C12) leaves only an intent mismatch during the build or a security issue at review as stops.

Generated by Claude Code

Activity

  1. added
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Oct 7, 2026
  2. github-actions commented on Oct 7, 2026

    @github-actions
    Contributor

    Proposed work class: work-class: scoped
    Basis: automated intake triage; the lanes App applied this class.

    Size: Medium
    Complexity: Medium
    Uncertainty: Knowable
    Flags: none
    Blocked by: none

    I understood this as a bounded rewrite of the three improvement skills (find, improve, setup) to the skill criteria. It ships as one draft PR, following the per-plugin runbook. The done-when list is clear: skill-quality check, eval validation, two probe files, a decision table, unmeasured items and a version entry. Eval spend is already covered by the cited owner decision. I found no open questions and no likely duplicates.

    Automated triage, applied by the lanes App.

  3. added theissue type on Oct 15, 2026
  4. added
    priority: mediumReal value, no hard deadline; normal backlog flow.
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    and removed
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Oct 15, 2026
  5. kyle-sexton commented on Oct 19, 2026

    @kyle-sexton
    MemberAuthor

    This was generated by AI during triage.

    Held: on #6476 (2026-10-18) the owner said the middle group of the concise-skills rollout is decided after batch 2's numbers; this plugin is not in batch 2.

  6. removed
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    on Oct 24, 2026
  7. kyle-sexton commented on Oct 24, 2026

    @kyle-sexton
    MemberAuthor

    Released by the owner's HITL session (2026-10-24, C12): it waited only on a removed gate. Intake triage re-runs on it to set its fields, then admission takes it.

  8. github-actions commented on Oct 25, 2026

    @github-actions
    Contributor

    The triage sweep dispatched intake triage for this issue (attempt 1 of 2).

  9. added
    status: readyTriaged, unblocked, and fully specified; eligible to pick up.
    work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.
    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    and removed
    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.
    on Oct 25, 2026
  10. melodic-automation-lanes commented on Oct 25, 2026

    @melodic-automation-lanes
    Contributor

    The work-resolve-issue lane stopped partway through this issue and needs a person.

    Why, in the run's own words:

    This lane cannot do the issue as written, so nothing was changed. Under the rewrite protocol in plugins/playbooks/skills/skill-authoring/reference/skill-criteria.md (Measurement, steps 4 and 6), only measured parts ship. That needs paid eval passes (/evals:plugin-eval before and after, on each target model), /evals:design cases, /evals:validate, /skill-quality:check (the before/after state and measure-invocation for the probe files) and a /docs-hygiene:compress compare meaning diff. The issue's Done-when list needs their output: the before and after numbers in the decision table, a passing /evals:validate and a /skill-quality:check comparison against main. This lane loads only the work-items plugin, and Bash runs only the named wrappers, so none of those skills, the claude CLI or an eval runner is available. Rewriting the skills without measuring them would break the protocol's ship-only-measured rule. Writing only probes or a changelog entry would leave each Done-when item unmet. Run this issue in an attended or eval-capable session with the evals, skill-quality and docs-hygiene plugins loaded and the --max-cost-usd 5 ceiling.

    What the run says it did not do:

    • The whole issue: rewriting the find, improve and setup skills, adding the probes/find.json and probes/improve.json probe files, the per-skill decision table with before and after numbers, the unmeasured-cases list and the changelog entry. Each needs eval or skill-quality tooling this lane does not l
    • /skill-quality:check plugins/improvement before and after, and /evals:validate on the plugin's eval suite: neither skill is available in this lane
    • Review, build and test steps: there was no diff to review or test

    Run: https://github.com/melodic-software/claude-code-plugins/actions/runs/40186330964

    To retry, remove needs-human and add agent-ready again.

  11. added
    host-runNeeds an unattended run on a host; the host runner takes it, not a person or the issue lane.
    status: confirmedA maintainer confirmed the item is real and in scope; ready to be worked.
    and removed
    status: readyTriaged, unblocked, and fully specified; eligible to pick up.
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    on Oct 27, 2026
  12. self-assigned this
    on Oct 31, 2026
  13. kyle-sexton commented on Oct 31, 2026

    @kyle-sexton
    MemberAuthor
    No description provided.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

host-runNeeds an unattended run on a host; the host runner takes it, not a person or the issue lane.priority: mediumReal value, no hard deadline; normal backlog flow.status: confirmedA maintainer confirmed the item is real and in scope; ready to be worked.work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.

Type

Fields

No fields configured for Task.

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions