docs(development): streaming construction plan rev 11 — the #1387 floor, per resource (#1387, #1456) - #1475
Conversation
…o as rev 11 (#1387, #1456) The plan of record for the #1387 ingest floor and the #1456 foundation lived only as a Claude artifact (rev 10) plus a pointer file in ~/.claude. Neither is readable outside a Claude session. This lands it as docs/development/streaming-construction-plan.md and indexes it from docs/engineering/README.md beside the bazel-migration family. Rev 11 is the refactor after the 2026-09-18 red-team critique of rev 10: - bytes per edge (1.2 KB read + 0.7 KB written, logical, constant across S22-S24) bind the floor before cores do; sequenced first, not last - the CPU budget is met single-threaded only: an F2 probe on the quiet host measures 15.07x SMT scaling for SHA-256 but 7.27x (sort) and 7.96x (zstd decode) on 16 threads, so the sort/decode-shaped majority of the path has a ceiling below the 8.13 cores the floor needs at today's CPU/edge - "71% serial" relabelled as seal's share of CPU; the instrument must report CPU-busy, off-CPU wait and achieved parallelism separately before any A/B - the refuted prefix-sum critical path removed; sequencing recorded as a maintainer decision, not decided here - merge-queue state recorded (eight of twelve PRs landed; five open) - 14-18% of ingest wall is outside every timed operation, measured on all nine rungs; publish (28.2 s at S22, 0.58 cores) added to "nothing sacred" - the floor is unchanged; five per-resource budgets are a marked proposal Every number is labelled measured or estimated and the two are not mixed in one table. No ladder was run; the only new measurement is the host probe. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Repository: CurateLabs/graphforge/.coderabbit.yaml Review profile: CHILL Plan: Advanced Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
Warning Billing warning: we have not been able to collect payment for this subscription for more than 72 hours. Please update the payment method or pay any pending invoices in Billing to avoid service interruption. Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
What
Writes the Streaming Construction Plan into the repository as
docs/development/streaming-construction-plan.md(rev 11) and indexes it fromdocs/engineering/README.md. Until now the plan of record for #1387 and #1456 existed only as a Claude artifact plus a pointer file under~/.claude, unreadable by anyone outside a Claude session.Location:
docs/development/, the established home for evidence-bearing plans (perf-g500-ladder.md,m4-exit-evidence.md, thebazel-migration-*family). Notdocs/adr/— it records no single decision and would trip the ADR frontmatter/index policy (ADR 0038, #1390). Not a docs-site page —docs-site/scripts/sync-content.mjspublishes an explicit allowlist of reader-facing development pages and this is an internal engineering plan like its siblings, so no sidebar entry.Why rev 11
Rev 10 was red-teamed on 2026-09-18 and scored 10/24. This revision fixes the five P0 and five P1 findings; the map is §0 of the document. The load-bearing changes:
concurrency_attributionmodule says so itself). §5 step 1 specifies the three numbers the instrument must report.publish(28.2 s at S22 at 0.58 cores) is on the "nothing sacred" list.What this does not do
Gates run
make pre-push-fastgreen;scripts/ci/adr-index.py check(34 active / 3 superseded agree);scripts/ci/test-text-checkout-policy.py(3,592 paths LF);scripts/source_size_policy.py(0 violations).Refs #1387, #1456, #1462, #1465, #1194.
🤖 Generated with Claude Code
Need help on this PR? Tag
@codesmith-botwith what you need. Autofix is disabled.