Skip to content

playbooks: retire the Opus 5 and Opus 4.8 chapters once they stop being fallback targets #4349

Open

Description

@kyle-sexton

Problem

The goal is to keep playbooks only for current models. Opus 5.5 replaced Opus 5, but opus-5.md and opus-4-8.md are still needed. Per the Claude Code model-config page (section "Automatic model fallback", read 2026-09-23), flagged requests fall back as follows:

  • On Fable 5.1, Fable 5 and Opus 5.5, biology-flagged requests re-run on Opus 5 and cybersecurity-flagged requests re-run on Opus 4.8.

So a session that is flagged continues on Opus 5 or Opus 4.8, and meta-rule 3 routes it to the matching chapter. Each chapter now says at its top that it is kept only for this reason.

Done when

When the fallback targets change, remove the chapter for any model that is no longer a target. Also update meta-rule 3, the fable-5 evals, and the CHANGELOG to match.

Trigger

The model-config "Automatic model fallback" section no longer names Opus 5 or Opus 4.8.

Activity

  1. added
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Sep 23, 2026
  2. kyle-sexton commented on Sep 27, 2026

    @kyle-sexton
    ContributorAuthor

    This was generated by AI during triage.

    Triage: briefed, human-gated (trigger not yet met)

    Verified 2026-09-27. The Claude Code model-config page, section "Automatic model fallback", still names both targets: on Fable 5.1, Fable 5 and Opus 5.5, biology-flagged requests re-run on Opus 5 and cybersecurity-flagged requests on Opus 4.8; on Opus 5, cybersecurity flags re-run on Opus 4.8. The trigger has not fired, so both chapters stay. Each chapter's opening line still states it is kept only as a fallback target, and the fable-5 meta-rule 3 still routes to both with a dated fallback citation.

    Why human-gated, not agent-ready: the work waits on an external doc change that no in-repo signal detects. An agent-ready label would have workers claim it, find the trigger unmet, and no-op on every pass. A human (or a docs-watch pass) re-reads the section and releases the item when it changes.

    Brief (for when the trigger fires)

    Precondition: re-read the model-config "Automatic model fallback" section. Act only on a model it no longer names as a fallback target. If both are still named, stop and change nothing.

    Behavior after the change:

    • The adaptation chapter for each model that is no longer a fallback target is removed from the playbooks model-adaptation reference set.
    • Meta-rule 3 in the fable-5 skill no longer routes to the removed chapter. Its fallback sentence matches the section as re-read, with the new read date. A model with no chapter falls back to the rule's existing "nearest prior version in your own family" path.
    • The fable-5 evals no longer expect routing to the removed chapter.
    • The playbooks CHANGELOG records the removal, and the plugin version is bumped by the repo's release convention.
    • No remaining reference to the removed chapter anywhere in the repo (sweep for stale references).

    Acceptance: the chapter set matches the current fallback targets; meta-rule 3 and the evals agree with it; the reference sweep finds no stragglers; the plugin's validation and evals pass.

    Out of scope: changes to the chapters that remain, and the Fable 5.1 doctrine regeneration (#4346).

    Priority set to priority: medium (assessed default; nothing is blocked on it).

  3. added
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    priority: mediumReal value, no hard deadline; normal backlog flow.
    and removed
    needs-triageNot yet classified. Floor until a type and one priority tier are set.
    on Sep 27, 2026
  4. added theissue type on Sep 27, 2026
  5. added 2 commits that reference this issue on Sep 28, 2026
  6. added
    work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.
    on Sep 29, 2026
  7. kyle-sexton commented on Sep 29, 2026

    @kyle-sexton
    ContributorAuthor

    Owner decision (2026-09-29): Keep this issue open, drop needs-human, and recheck the Claude Code model-config "Automatic model fallback" section on a schedule. The trigger has not fired: as of 2026-09-29 the section still names Opus 5 and Opus 4.8 as fallback targets, so both chapters stay.

    Next: needs-human is removed and agent-ready added. An agent rechecks the section; if both models are still named it changes nothing, and if either is dropped it follows the brief in the triage comment (remove that chapter, update meta-rule 3, evals, CHANGELOG, sweep references).

  8. added
    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.
    and removed
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    on Sep 29, 2026
  9. kyle-sexton commented on Oct 4, 2026

    @kyle-sexton
    ContributorAuthor

    This was generated by AI during work-loop.

    Ratify autonomous dispatch of this C3 bug-fix item?

    Classification: work-class: scoped (C3), bug-fix-shaped. Intended dispatch: the work-loop worker lane, through /work-items:work, to a draft PR the lane never merges. The lane has not completed its first drain and no item-level ratification exists, so the item is queued here instead of dispatched. Ratify it through /work-items:attend-queue, and it returns to the frontier and dispatches on a later cycle.

    Lane: work-loop, instance melo-worker-1, cycle 1.

  10. added
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    and removed
    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.
    on Oct 4, 2026
  11. self-assigned this
    on Oct 4, 2026
  12. kyle-sexton commented on Oct 4, 2026

    @kyle-sexton
    ContributorAuthor
    No description provided.
  13. kyle-sexton commented on Oct 4, 2026

    @kyle-sexton
    ContributorAuthor

    This was generated by AI during attend-queue.

    Operator direction (2026-10-04): "go with the recommendations." This records that decision.

    Ratification declined: the trigger has not fired. The code.claude.com model-config page (fetched 2026-10-04), under "Automatic model fallback", still names Opus 5 (biology) and Opus 4.8 (cybersecurity) as fallback targets. A worker dispatched now would find nothing to do. The item stays needs-human as a watch item. Recheck when that section stops naming either model, then act only on the model it no longer names.

  14. removed their assignment
    on Oct 4, 2026
  15. kyle-sexton commented on Oct 13, 2026

    @kyle-sexton
    ContributorAuthor

    Decision recorded. The owner accepted the adjudicated recommendation on 2026-10-12.

    Keep #4349 open with needs-human; add one monthly recurring-schedule row (trigger claude-model-release) that re-reads model-config#automatic-model-fallback and comments the result on #4349. Drop the seed's 'close it' option.

    Why: The trigger has not fired: the live model-config page (lines 521, 523, read 2026-10-12) still names Opus 5 and Opus 4.8, and the API deprecations page keeps both Active until at least 2027-07-24 and 2027-05-28. Both owner decisions (2026-09-29, 2026-10-04) keep the issue open, so the seed's close recommendation loses under precedence rule 2; the 09-29 decision asked for a scheduled recheck that nothing performs today (origin/main recurring-schedule.json has 4 rows, none covers the section; check-stamps.sh:487 treats any recheck trigger as clearing the stamp, so the SKILL.md:19 pointer has no consumer). The 10-04 record set the label back to needs-human but is silent on the schedule, so the newer decision governs the label and the older one's schedule request stands unrevoked.

    Precedence applied: Rule 2 (owner's newest explicit decision): the seed's close recommendation (rule 5) loses to the 2026-09-29 and 2026-10-04 owner decisions, both of which keep #4349 open. Between the two owner decisions, the newer 2026-10-04 record governs the label (needs-human) and, being silent on the schedule, leaves the 2026-09-29 schedule request in force. Researcher disagreements (B's claude-model-release trigger, A's Sonnet 5 scope) are additive and both adopted.

    Sources:

    • https://code.claude.com/docs/en/model-config.md lines 515-523 (curl 2026-10-12): Fable 5.1/5 and Opus 5.5 fall back to Opus 5 (biology) and Opus 4.8 (cyber); Opus 5 cyber to Opus 4.8; Sonnet 5.5 cyber to Sonnet 5
    • https://platform.claude.com/docs/en/about-claude/model-deprecations.md lines 77-78, 85 (curl 2026-10-12): claude-opus-5 Active, not sooner than 2027-07-24; claude-opus-4-8 Active, not sooner than 2027-05-28; claude-sonnet-5 Active, not sooner than 2027-06-30
    • https://raw.githubusercontent.com/anthropics/claude-code/main/CHANGELOG.md head 2.1.296 (2026-10-12); researcher B's grep found no fallback-target change
    • gh issue view 4349 (2026-10-12): OPEN; labels needs-human, priority: medium, work-class: scoped; owner comment 2026-09-29T17:22:23Z 'Keep this issue open, drop needs-human, and recheck ... on a schedule'; AI record 2026-10-04T05:49:33Z of operator direction 'go with the recommendations': ratification declined, 'stays needs-human as a watch item', no mention of the schedule
    • origin/main .github/recurring-schedule.json: 4 rows (frontier-release-instruction-ablation, listing-budget-watch, stale-doc-drift-watch, agents-md-cutover-check); none covers the fallback section; agents-md-cutover-check is the monthly-plus-trigger, comment-on-open-issue precedent; trigger id claude-model-release exists
    • origin/main plugins/attribution/skills/audit/scripts/check-stamps.sh:487 'A recheck trigger anywhere on the surface clears every stamp in it'

    Next: Open a draft PR adding one row to .github/recurring-schedule.json modeled on agents-md-cutover-check: id model-fallback-targets-watch; cadence monthly; triggers ["claude-model-release"]; close_previous true; notes: re-read https://code.claude.com/docs/en/model-config#automatic-model-fallback and comment the result on #4349; report-only (C1); if the section still names Opus 5, Opus 4.8 and Sonnet 5, change nothing and leave #4349 needs-human; if it drops Opus 5 or Opus 4.8, the operator releases #4349 (drop needs-human) and the 2026-09-27 triage brief runs; if it drops Sonnet 5, file a sibling issue for sonnet-5.md (nothing tracks it today); retire the row when #4349 and that sibling close. Change no label or comment on #4349 in this pass. Cadence monthly is judgment from the precedent row; the trigger is the backstop for a change that ships with a model release.

    Researched by two independent agents (local evidence and upstream docs) and adjudicated by a third.

  16. kyle-sexton commented on Oct 13, 2026

    @kyle-sexton
    ContributorAuthor

    Owner batch-ratified this admission in an attended session on 2026-10-12: work-class: scoped. Rule: class C1-C3, no trust surface, the independent check confirmed the recorded decision, and no owner step remains.

  17. added
    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.
    and removed
    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.
    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.
    on Oct 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    priority: mediumReal value, no hard deadline; normal backlog flow.work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.

    Type

    Fields

    No fields configured for Task.

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions