Skip to content

feat(bench): add #900 ladder bundle ingest and fix parity gate (#959) - #1056

Merged
DecisionNerd merged 1 commit into
mainfrom
cursor/959-ladder-ingest-5258
Sep 1, 2026
Merged

DecisionNerd merged 1 commit into
mainfrom
cursor/959-ladder-ingest-5258

Conversation

@DecisionNerd

@DecisionNerd DecisionNerd commented Sep 1, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Prepares the #959 post-#900 workflow:

  • graphforge_bench.ladder_bundle_ingest validates completed test(scale): complete the S18-S26 lifecycle ladder on OVHC-AGENCY #900 output (manifest, sN-rung.json, teardown inventory) against checked-in schemas and optionally copies it into fixtures/parity/ladder-bundle/.
  • make -C benchmarks ingest-ladder-bundle SOURCE=... runs the ingest path; VALIDATE_ONLY=1 validates without copying.
  • Fixes parity_gate: harness_authoritative_after_ladder_comparison now turns green when ingested ladder bundles pass parity comparison; legacy retirement criterion reports a distinct blocker once ladder parity is green.

Testing

cd benchmarks
PYTHONPATH=harness uv run --locked python -m unittest tests.test_ladder_bundle_ingest tests.test_parity_gate
make parity-gate  # still blocked until real #900 bundles ingested

Related issues

Part of epic #952.

Open in Web Open in Cursor 

View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need. Autofix is disabled.

Add validate/ingest tooling for completed Fly ladder bundles, fix
harness_authoritative_after_ladder_comparison to reflect ingested bundle
parity, and clarify legacy retirement blocker once ladder parity is green.

Co-authored-by: David Spencer <DecisionNerd@users.noreply.github.com>
@github-actions github-actions Bot added documentation Improvements or additions to documentation release:none No release note or version impact labels Sep 1, 2026
@coderabbitai

coderabbitai Bot commented Sep 1, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Essentials

Run ID: 137af34f-8dc9-4806-b484-92db9a7e5c90

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Warning

Billing warning: we have not been able to collect payment for this subscription for more than 72 hours. Please update the payment method or pay any pending invoices in Billing to avoid service interruption.


Comment @coderabbitai help to get the list of available commands.

@DecisionNerd
DecisionNerd merged commit 6620738 into main Sep 1, 2026
21 checks passed
@DecisionNerd
DecisionNerd deleted the cursor/959-ladder-ingest-5258 branch September 1, 2026 00:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation release:none No release note or version impact

Projects

None yet

Development

Successfully merging this pull request may close these issues.

epic(bench): standardize BenchExec and Divan measurement and retire custom benchmark harnesses

2 participants