Skip to content

docs: ship DOC bundle 4 — matrix pointers, archive-reading conventions, residual-risk footer - #1898

Merged
kyle-sexton merged 5 commits into
mainfrom
docs/corpus-doc-bundle4
Aug 4, 2026
Merged

docs: ship DOC bundle 4 — matrix pointers, archive-reading conventions, residual-risk footer#1898
kyle-sexton merged 5 commits into
mainfrom
docs/corpus-doc-bundle4

Conversation

@kyle-sexton

Copy link
Copy Markdown
Contributor

Summary

DOC bundle 4 of the doc-corpus application campaign — the three unblocked rows (playbooks 0.6.6 → 0.6.7; knowledge 0.10.19 → 0.10.20):

  • Point at a per-model matrix; never copy one (fable-5/context/calibration.md + one SKILL.md line): a third source-grading axis (volatility) beside the surface and channel axes — point at the vendor page that owns a per-model table; a stated matrix carries a re-check trigger naming the next model release; table presence is not reachability where you run. Worked instance corrected at the bytes: Claude Mythos 5 is a known registry model with full gating machinery and still not selectable — exactly one non-null provider id beside seven null siblings (the earlier "all eight null" figure was schema-disproven; the correction and its reason are in the CHANGELOG).
  • Archive-reading conventions (knowledge profile): a dated entry is not a content-change signal (two byte-identical entries five days apart prove it); absence of bold does not prove absence of change — deltas come from diffing entries, never reading markup; note a source artifact at the row, never silently repair it (with the one reader-facing exception stated). Recheck against the UNC-1 ruling confirmed no premise moved — the ruling touched tags, these are page properties.
  • Residual-risk footer (knowledge profile): the reduce-hallucinations page's own hedge, quoted verbatim (byte-compared live), scope unbroadened — hallucinations only, no validator named — with the cite-never-restate rider for graduated chapters.

Fourth commit removes a cross-plugin dependency claim and an internal-record pointer from the knowledge CHANGELOG (self-caught; disclosed).

Independently verified (fresh-context, rationale withheld): SHIP, zero findings — EC-3 seven-count, UNC-1 no-retag ruling, byte-identical-entries evidence, and the footer byte-compare all re-derived by the verifier.

No linked issue

Related

🤖 Generated with Claude Code

https://claude.ai/code/session_011UarawwEnZQu7cB6i7WatJ

kyle-sexton and others added 4 commits August 3, 2026 18:49
Adds a volatility axis to the fable-5 calibration chapter, beside the
surface axis and the channel axis its neighbours already own. A per-model
table reads as a fact and is actually a snapshot: a row is added or a
default flips with each model release, and a pasted copy stays confidently
wrong with nothing in it saying which day it was true.

The rule is point-at-the-owning-table. For thinking configuration that
table is the per-model table on Troubleshooting thinking, re-fetched
2026-08-03 (HTTP 200), which is the authority on what each model accepts,
defaults to, and rejects. A matrix stated anyway — because the reader
cannot act without the values in front of them — carries a re-check
trigger naming the next model release, so a stale row is found by a
scheduled read rather than by a reader acting on it.

The fourth rule ties the section to its neighbour: a vendor matrix is an
API-surface fact, so presence in the table is not reachability where the
reader is running. The worked instance is verified on both sides
2026-08-03. Claude Mythos 5 has its own row in that table, and in Claude
Code it is a known model in the registry with full gating machinery and
still not selectable — no alias resolves to it, it is absent from
latest_per_family, it declares no capabilities, and it exposes no picker
row. Its registry entry carries exactly one non-null provider id
(first_party) beside seven null siblings; the count is stated at seven
because the schema makes first_party non-nullable and exactly seven
siblings nullish, which disproves an earlier reading that put every
provider id null and counted eight.

SKILL.md carries the distilled line under "Ground truth and checking —
calibration". Prose only; playbooks 0.6.6 -> 0.6.7.

Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
…opic profile

Some pages this publisher maintains are archives — dated entries
accumulated over time rather than a current statement, the published
system prompts being the standing case. Three of their properties are
invisible from inside any single entry, so a digest that does not know
them reads the archive wrong in a way its own verification cannot catch.
Each was found independently by several digest units before it became a
convention.

A dated entry is not a content-change signal: two entries five days apart
are byte-identical, differing on zero lines across 100-line bodies, and
the page carries no annotation explaining why the second exists. The rule
is stated in the narrower content-change form — it bars inferring change
from sameness, and leaves a reader free to read an actual textual
narrowing between entries as the change it is.

Absence of bold does not prove absence of change: the page states that
updates between versions are bolded and the convention does not hold. One
span carries zero bold markup across three dated entries differing in
three sentences plus a twelve-paragraph addition; another marks one
transition of three; silent unbolded typo fixes and a silent removal were
found the same way. Deltas therefore come from diffing entries, never
from reading the markup.

Note a source artifact at the row and never silently repair it: typos,
escaped markup and malformed auto-links are reproduced byte-exact so a
verifier can distinguish faithful reproduction from digest transcription
error. The blog channel's two known extraction artifacts are named as the
standing instance rather than restated. The one exception runs the other
way — a downstream artifact reproducing a known-corrupt entry for a
reader rather than for verification repairs the corruption and says so.

The fourth property these three refine, that dated content is scoped to
its entry date, is deliberately not restated: it already ships as
reader-side doctrine in the playbooks fable-5 calibration chapter, and
the new section carries it as the premise its three rules qualify.

Prose only; knowledge 0.10.19 -> 0.10.20.

Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
…file

A source's own hedge now travels with the content it qualifies. An
artifact graduated from this publisher preserves the hedge as the source
states it — neither dropped as throat-clearing nor widened past what the
source claims. Two instances graduate under the one convention rather
than each inventing its own: the residual-risk footer, and the harness
best-practices material's "starting points, not set in stone"
relativization.

The footer is quoted rather than paraphrased from Reduce hallucinations,
re-fetched 2026-08-03 (HTTP 200), where the sentence is byte-identical to
the snapshot the corpus froze: "Remember, while these techniques
significantly reduce hallucinations, they don't eliminate them entirely.
Always validate critical information, especially for high-stakes
decisions."

Its scope is the source's own and is deliberately not broadened. It is
about hallucinations, not errors or guardrail failures in general, and it
names no validator — who or what validates critical information is
unstated in the source and stays unstated here. That scoping is the part
most likely to be lost in transit: it survived two correction rounds
during the slice's verification, both of which caught a widening.

Placement is the profile rather than per artifact, because the profile is
the seam every guardrail slice of this publisher flows through, so the
footer applies without per-artifact restatement and a graduated chapter
or template cites it rather than copying it.

Prose only; knowledge already at 0.10.20 from the preceding commit.

Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
…0 entry

The archive-reading-conventions entry closed by saying the date-scoping
property "already ships as reader-side doctrine in the playbooks fable-5
calibration chapter". That makes a delivery record for one plugin depend
on a file in another: nothing enforces that the chapter keeps carrying
the rule, and a consumer who installs knowledge without playbooks reads a
pointer to a file they do not have. The profile section itself was never
affected — it states the property inline as its own opening premise — so
the entry now describes that structure instead of pointing outward.

The same bullet also justified the content-change wording by contrast
with "the two the record carries", a reference to an internal working
record no consumer can read. The rule's own wording is the naming, so the
justification now stands on what the finding supports.

Prose only; no version change.

Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
@cursor

cursor Bot commented Aug 4, 2026

Copy link
Copy Markdown

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

@claude

claude Bot commented Aug 4, 2026

Copy link
Copy Markdown

Claude finished @kyle-sexton's task in 2m 55s —— View job


Reviewing PR #1898

  • Gather context (diff, CLAUDE.md, REVIEW.md)
  • Review changed files for correctness & alignment
  • Post findings

Review

Scope: docs-only bundle across knowledge (0.10.19 → 0.10.20) and playbooks (0.6.6 → 0.6.7) — CHANGELOG entries, two skill-context prose additions, and one distilled SKILL.md line. Per CLAUDE.md, a skill's prose body is out of scope for the fresh-docs mandate (only frontmatter/contract surfaces are in), so no doc-index/citation gate applies here — this is a pure code-review pass.

Verified as correct:

  • Version/changelog sync. plugins/knowledge/.claude-plugin/plugin.json0.10.20 and plugins/playbooks/.claude-plugin/plugin.json0.6.7 both match their CHANGELOG.md headers, formatted consistently with prior entries (no dates in headers, matching existing precedent).
  • Residual-risk footer quote is byte-exact. Live-fetched Reduce hallucinations today and diffed against the quoted sentence in anthropic-docs-profile.md#L292-293 and the CHANGELOG restatement — both match the live page verbatim, including the "no validator named" scoping claim.
  • Fourth commit's self-correction is clean. The dropped cross-plugin dependency claim (plugins/knowledge/CHANGELOG.md) leaves no dangling reference — grepped the whole knowledge plugin for "fable-5 calibration" / "the two the record carries" and found nothing left pointing outward. The property it used to defer to (dated-entry date-scoping) is in fact stated inline as the section's own opening premise in anthropic-docs-profile.md, so the corrected wording is accurate, not just prose cleanup.
  • Cross-file consistency. The "seven null siblings" / Mythos-5 worked instance is stated identically (count and mechanism) across playbooks/CHANGELOG.md, calibration.md, and the commit message; SKILL.md's one-line distillation correctly omits the worked-instance detail, consistent with how neighboring distilled bullets in that file summarize their chapters.
  • PR-body linkage contract. "No linked issue" + non-empty ## Related section satisfies .github/workflows/pr-issue-linkage.yml.
  • Commit hygiene. All four commits are Conventional-Commits-formatted, scoped tightly to the files they describe (verified via git show --stat per commit), consistent with AGENTS.md's explicit-paths staging guidance.

Findings: none that rise to a fix. One cosmetic nit not worth a review comment: plugins/knowledge/CHANGELOG.md#L21-L22 wraps the **(2) bold-marker across a line break mid-tag — renders fine in Markdown (no blank line between), purely a wrapping artifact.

No code paths, manifests, or contract surfaces changed — nothing to build/lint/test beyond the markdown itself, and no security-relevant surface (hooks, MCP, userConfig, cache isolation) is touched, so that lane has nothing to review here.

@claude

claude Bot commented Aug 4, 2026

Copy link
Copy Markdown

Claude finished @kyle-sexton's task in 1m 4s —— View job


Security review complete

  • Gather context (PR diff against merge-base 7d65b2a, since origin/main...HEAD has no merge base due to the branch predating a later main commit)
  • Review changed files for security issues
  • Post findings

Scope reviewed (7 files, +146/-2):

  • plugins/knowledge/.claude-plugin/plugin.json — version bump only (0.10.19 → 0.10.20)
  • plugins/playbooks/.claude-plugin/plugin.json — version bump only (0.6.6 → 0.6.7)
  • plugins/knowledge/CHANGELOG.md, plugins/playbooks/CHANGELOG.md — changelog prose
  • plugins/knowledge/skills/docpage-digest/context/anthropic-docs-profile.md — prose additions (archive-reading conventions, residual-risk footer)
  • plugins/playbooks/skills/fable-5/SKILL.md, plugins/playbooks/skills/fable-5/context/calibration.md — prose additions (per-model-matrix pointer rule)

Findings

None. This PR contains no security-relevant surface:

  • No workflow files, hooks, .mcp.json entries, or executable scripts are touched.
  • No changes to permissions:, plugin capabilities, or trust boundaries.
  • No shell command construction, no injection surfaces (command/SQL/path/template).
  • No secrets, tokens, or credentials are introduced or handled.
  • The two plugin.json diffs are strictly semver bumps — no other manifest fields changed.
  • All remaining content is markdown prose (CHANGELOG entries and skill-context doctrine text) — instructional guidance consumed by an LLM reading the skill, not executed code. The doc URLs cited (platform.claude.com, code.claude.com) are Anthropic's own documentation domains, consistent with this repo's fresh-docs sourcing convention, not attacker-controlled input.

Nothing here falls in scope for a code-execution, authz, injection, secret-handling, or CI/workflow-permission finding.

@github-actions

github-actions Bot commented Aug 4, 2026

Copy link
Copy Markdown

Claude has reviewed this PR 2 times. The lane skips further automatic reviews after 5; deleting this comment resets the count.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 3a5b522baa

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread plugins/knowledge/skills/docpage-digest/context/anthropic-docs-profile.md Outdated
… own hedge

Review finding: the rule attached the reduce-hallucinations sentence to
every guardrail-derived artifact, but that quote's "these techniques"
refers to one page's techniques — applied elsewhere it either
misattributes a hallucination benefit or forces a scope violation. The
rule now requires each guardrail page's own residual-risk sentence,
with the reduce-hallucinations quote as the standing instance for
artifacts derived from that page.

Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
@claude

claude Bot commented Aug 4, 2026

Copy link
Copy Markdown

Claude finished @kyle-sexton's task in 1m 56s —— View job


Reviewing PR #1898 (re-review after synchronize)

  • Gather context (new commits since last review, diff)
  • Review changed files for correctness & alignment
  • Post findings

Review

New since the last review pass: commit 796c828 responds to Codex's P2 finding by rescoping the residual-risk footer rule in anthropic-docs-profile.md — each guardrail page now carries its own hedge, with the reduce-hallucinations quote demoted to "the standing instance" for artifacts derived from that page specifically, not a universal footer. That rewrite is correct and reads well: L281-L303.

Finding: the fix wasn't propagated to plugins/knowledge/CHANGELOG.md, which still asserts the pre-fix universal-footer claim.

plugins/knowledge/CHANGELOG.md#L36-L52 (0.10.20 entry, unchanged by commit 796c828) still closes with:

...because the profile is the seam every guardrail slice of this publisher flows through, so a graduated chapter or template cites the footer and never restates it.

"The footer" here is the singular reduce-hallucinations quote introduced two sentences earlier — this is exactly the claim Codex flagged and the profile file was just corrected to drop (every guardrail-derived artifact citing the reduce-hallucinations footer, rather than each page's own hedge). The CHANGELOG entry is even internally inconsistent with itself: it names the harness best-practices "starting points, not set in stone" relativization as the second of "two instances [that] graduate under the one convention" (L39-41) — i.e., a different hedge text — then says every graduated chapter cites "the footer" (singular), which can't be true of the best-practices artifact citing a relativization sentence that isn't the reduce-hallucinations footer at all.

Since this PR bundles both the original footer rule and its correction into one version bump (0.10.20), the changelog entry describing what shipped should match the corrected rule, not the superseded one.

Fix this →

Everything else re-verified clean:

  • The rescoped rule text itself is accurate and matches the pattern the profile already uses elsewhere (source-scoped hedges, cite-never-restate).
  • No other files changed since the last review pass; the earlier findings (version/changelog sync, byte-exact quote verification, PR-linkage contract, commit hygiene) still hold for the unchanged files.
  • Scope stays docs-only; nothing here touches a contract surface per CLAUDE.md's fresh-docs mandate, and no security-relevant surface is touched (that lane already cleared this PR).

@claude

claude Bot commented Aug 4, 2026

Copy link
Copy Markdown

Claude finished @kyle-sexton's task in 58s —— View job


Security review complete

  • Gather context (git diff 7d65b2a...HEAD, since the branch has no merge-base with origin/main)
  • Review changed files for security issues
  • Post findings

Scope reviewed (7 files, +148/-2) — unchanged from the prior review pass, plus one new commit (796c828) that only edits prose:

  • plugins/knowledge/.claude-plugin/plugin.json — version bump only (0.10.19 → 0.10.20)
  • plugins/playbooks/.claude-plugin/plugin.json — version bump only (0.6.6 → 0.6.7)
  • plugins/knowledge/CHANGELOG.md, plugins/playbooks/CHANGELOG.md — changelog prose
  • plugins/knowledge/skills/docpage-digest/context/anthropic-docs-profile.md — prose additions (archive-reading conventions, residual-risk footer, plus the latest commit's scope fix confining the footer to each guardrail page's own hedge)
  • plugins/playbooks/skills/fable-5/SKILL.md, plugins/playbooks/skills/fable-5/context/calibration.md — prose additions (per-model-matrix pointer rule)

Findings

None. No security-relevant surface is touched by this PR:

  • No workflow files (.github/workflows/**), hooks, .mcp.json entries, or executable scripts are added or modified.
  • No changes to permissions:, plugin capabilities, or trust boundaries.
  • No shell command construction and no injection surfaces (command/SQL/path/template).
  • No secrets, tokens, or credentials introduced or handled.
  • The two plugin.json diffs are strictly semver bumps — no other manifest fields changed.
  • The one commit added since the last pass (796c8284) only narrows a documentation claim (the residual-risk footer now scopes to each guardrail page's own hedge instead of over-applying the reduce-hallucinations quote) — a correctness/accuracy fix in prose, not a security-relevant change.
  • All remaining content is markdown prose (CHANGELOG entries and skill-context doctrine text) — instructional guidance consumed by an LLM reading the skill, not executed code. Cited doc URLs (platform.claude.com, code.claude.com) are Anthropic's own documentation domains, consistent with this repo's fresh-docs sourcing convention, not attacker-controlled input.

Nothing here falls in scope for a code-execution, authz, injection, secret-handling, or CI/workflow-permission finding.

@kyle-sexton
kyle-sexton merged commit 31011a8 into main Aug 4, 2026
32 checks passed
@kyle-sexton
kyle-sexton deleted the docs/corpus-doc-bundle4 branch August 4, 2026 00:50
kyle-sexton added a commit that referenced this pull request Aug 5, 2026
…#1936)

## Summary

Implements the PA-H interview decision (locked 2026-08-02) in the
Anthropic docs profile: the
applicability filter gains one `tag-exempt (<sub-shape>)` disposition
for rows carrying no
guidance for ANY surface the vocabulary adjudicates, with four
documented sub-shapes
(consumer-surface, archive-descriptive, metadata, navigation-pointer),
the sub-shape named at the
row. The class describes the material's genre and asserts nothing about
harness applicability -
not a positive tag, not a negative claim - so it owes no live-doc
citation and no absence basis,
and the near-miss disclosure burden never attaches. `api-only` remains
reserved for rows that DO
assert a harness absence for their own specific assertion. Consistent
with the co-decided PA-AI
Reading 1 (a positive tag asserts harness applicability and requires a
live-doc citation).

- `anthropic-docs-profile.md`: vocabulary intro mentions the tag-exempt
disposition; new bullet in
  the applicability-filter section defines the class
- knowledge plugin `0.10.22` -> `0.10.23` + CHANGELOG entry

The memory-tier retag sweep over the system-prompts slice (the
decision's implementation cost) is
performed separately in `.work/` and is never committed.

No linked issue

## Related

- PR #1898 (archive-reading conventions, knowledge 0.10.20) - same
profile, same campaign
- PR #1928 (model-matching table alignment, knowledge 0.10.22) - most
recent edit to this profile

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant