Repository navigation
Open
Labels
enhancementNew feature, sensor, or structural signatureNew feature, sensor, or structural signatureenterpriseSpecialized deployment, SSO, or compliance for enterprise tierSpecialized deployment, SSO, or compliance for enterprise tierlegacy-modernizationCOBOL refractor, dead-code extraction, and JCL forgingCOBOL refractor, dead-code extraction, and JCL forgingpriority: mediumscope:infraCI, tooling, churn/factory, docs infrastructureCI, tooling, churn/factory, docs infrastructuretier:customerChurn tier 2: front-facing customer itemsChurn tier 2: front-facing customer items
Description
Why. When a customer runs a zero-gap scan on their own machine, two people need the blocker list:
- The customer, who needs every detail (files, programs, symbols, copybooks, tables) to work through their own tickets.
- Us, because their blockers are what tell us where the engine has to improve next. Customers won't send us source code or their names for things, so today we have no way of seeing what blocked them.
So the report should come in two forms from one run: a full report that stays with the customer, and an anonymized one they can send to us safely. The anonymized report then feeds our own engine-fixing loop (the churn/shepherd harness), the same way our own estates do today.
What.
- Full report. Everything Equivalence harness: self-report coverage, run status and actionable blockers as a generated .md page #4493 describes: coverage, run status per program, and blockers stated as fixes, with the files, symbols and unlock counts named. This one never leaves the customer's machine.
- Anonymized report. Generated from the same data in the same run (
--anonymize, or always written next to the full one) as Markdown + JSON. It keeps the shape of each blocker and removes anything that identifies the customer:- Kept: the blocker category and sub-class (layout / non-VSAM input / cross-record rule / unresolved link / environment / CICS command family / dialect …), the construct signature (e.g.
EXEC CICS READQ TS … NUMITEMS,REDEFINES selected by sibling field,RECFM V), counts (programs blocked, tests unlocked, how often it occurs), the engine and rule-catalogue version, and refusal codes. - Removed: program, copybook, file, dataset, table, queue, transaction and field names; literals and comments; paths; and any source lines.
- Hashed instead of dropped: identifiers become a salted hash (
PGM_7f3a,TBL_19c2), with one salt per customer kept on their side. Their runs can then be compared over time ("this blocker is still open after 3 releases"), but nothing can be matched across customers or reversed. - A small minimal repro where possible. For example, a synthetic COBOL/CICS snippet built from the construct signature with made-up names, so we can reproduce the blocker without their code.
- Kept: the blocker category and sub-class (layout / non-VSAM input / cross-record rule / unresolved link / environment / CICS command family / dialect …), the construct signature (e.g.
- A manifest the customer can review. It's a short list of exactly what fields the anonymized file contains, so their security team can approve sending it, plus a
--redact-moreoption to drop sub-classes or counts if they want. - Ingestion on our side. We need a command that takes a customer's anonymized report and turns each blocker into a ledger row (Ledger: tag port blockers (det / forge / facade / harness) by the estate that exposed them, beside field_testing.json's defects #5051, with
estate: customer:<hash>), linking it to an existing issue when the construct signature matches one, or opening a new one when it doesn't. The anonymized report becomes one more input to the churn queue.
Done when:
- One run writes both reports. Every blocker in the full report appears in the anonymized one under the same category, with the same counts.
- A leak test passes. On a fixture estate, scan the anonymized output for every identifier, literal, comment and path in the source, and fail if any of them appear. This runs in CI on the crucible estates (CardDemo, GenApp, CBSA, zECS, cics-crucible).
- The hashes don't change between runs with the same salt, and they do change with a different salt.
- Ingesting an anonymized report from one of our own estates creates ledger rows that match the blockers we already know that estate has.
- The anonymized format is documented as a public schema with a version, so customers can audit it.
Related: #4493 (generated blocker page; this is its full form plus a twin that's safe to send), #5051 (port-blocker ledger; where ingested reports land), #5052 (economics of the iterative loop), #4724 (readiness scanner support matrix), #4055 (product is the proof).
Metadata
Metadata
Assignees
Labels
enhancementNew feature, sensor, or structural signatureNew feature, sensor, or structural signatureenterpriseSpecialized deployment, SSO, or compliance for enterprise tierSpecialized deployment, SSO, or compliance for enterprise tierlegacy-modernizationCOBOL refractor, dead-code extraction, and JCL forgingCOBOL refractor, dead-code extraction, and JCL forgingpriority: mediumscope:infraCI, tooling, churn/factory, docs infrastructureCI, tooling, churn/factory, docs infrastructuretier:customerChurn tier 2: front-facing customer itemsChurn tier 2: front-facing customer items
Activity
Fix full-suite: list blocker_report as a CICS-spec importer, read est…
Blocker report: full + anonymized twin from one run, salted hashes, l…
Blocker report: minimal synthetic repro per anonymized blocker, cics-…
gap_prevalence: rank unmodelled/refused constructs by estates, progra…
Blocker report: ingest an anonymized report into a customer-side ledg…
Regenerate docs_read_by_tests.txt after merging main (Part of #5054)
Blocker report: per-burned-estate report + ingest check in Evidence R…
Regenerate docs_read_by_tests.txt (Part of #5054)
Blocker feed: require the leak scan on every burned estate, publish u…
Blocker feed closure audit: manifest prose is not a leak, harness pub…
Blocker feed: survey cics-crucible so its leak scan runs; a feed fail…
genapp lgdpvs01/lgucvs01: state LGSTSQ-path notes now X6 is modelled …
Blocker ingest: customer rows are full #5051 rows with an open/closed…
X6: a WRITEQ LENGTH past FROM is FROM's bytes then spaces, ASSUMED on…
Blocker feed: queue one item per construct, open its issue once and l…
Fix main red after #6573: LGSTSQ/LGAPVS01/LGUPVS01 ports and re-proof…
Blocker leak scan on the burned estates runs on every PR that reaches…
squid-protocol commentedon Oct 25, 2026
Churn run
5054-20261025T0611Z(host melek) ended without a PR. denied; sent back onceRegenerate docs_read_by_tests.txt for the readiness blocker tests (Pa…
readiness_report: one run writes the full and anonymized blocker repo…
blocker leak test: run it in the cics-crucible checkout step, refresh…
blocker leak test: real readiness --blockers output vs the estate sou…