Skip to content
This repository was archived by the owner on Sep 28, 2026. It is now read-only.

docs: cross-link dynamic-workflow test cases into the README [skip ci] - #19

Merged
jnyross merged 1 commit into
mainfrom
docs/cross-link-testcases
Aug 9, 2026
Merged

jnyross merged 1 commit into
mainfrom
docs/cross-link-testcases

Conversation

@jnyross

@jnyross jnyross commented Aug 9, 2026 •

Copy link
Copy Markdown
Owner

What

Docs-only cross-links for the PR #16 material (skills/codex-graph/testcases/, docs/dynamic-workflow-testcase-catalog.md) into the surfaces readers already use — the new files were reachable only by directory browsing:

  • Validate section: suite-scope sentence was stale (predated run_regressions.sh steps 4–5); now names the dynamic-workflow testcase suite and topology-hint lint, and the coverage sentence includes the three pattern-derived collection scenarios. Added a short "Dynamic-workflow test cases" subsection with the check_workflow.js one-liner and pointers to testcases/README.md (expectation semantics) and the catalog doc (source survey, tier/contract mapping).
  • Add regression coverage with new features: contribution rule now offers a golden case under testcases/cases/ as an alternative to a task_collection_harness.test.js scenario.
  • Repository layout: two new index entries (skills/codex-graph/testcases/, docs/dynamic-workflow-testcase-catalog.md).

Verified the new docs' own path references: neither file uses markdown links; all backticked repo-root paths resolve on main @ c27a4d4.

Regression coverage

None added — documentation-only change (per the template's doc-only exception). Full suite run locally before push: sh scripts/run_regressions.sh → validator PASS, selfcheck PASS, 17/17 collection tests, 19/19 testcase tests, hint lint PASS, release tests OK.

Merge note

Keep [skip ci] in the squash subject to avoid a spurious patch release for a docs change. Deliberately does not touch SKILL.md or references/ (sibling PRs #17/#18 own those hunks).


Note

Low Risk
Documentation-only README edits with no runtime, skill, or workflow behavior changes.

Overview
Cross-links the existing skills/codex-graph/testcases/ and docs/dynamic-workflow-testcase-catalog.md material into the main README so readers do not have to discover them by browsing directories.

The Validate section now matches what run_regressions.sh actually runs: dynamic-workflow test cases with topology-hint lint, plus pattern-derived collection scenarios in the suite description. A new Dynamic-workflow test cases subsection gives the check_workflow.js one-liner and points to testcases/README.md and the catalog doc.

Add regression coverage now lists adding a golden case under testcases/cases/ as an alternative to task_collection_harness.test.js. Repository layout gains two index bullets for the testcase tree and catalog doc.

Reviewed by Cursor Bugbot for commit 20604ac. Bugbot is set up for automated code reviews on this repo. Configure here.

Summary by CodeRabbit

  • Documentation
    • Expanded regression testing documentation to cover graph-coherence checks, dynamic workflows, topology hints, and additional scenarios.
    • Added instructions for running dynamic-workflow golden-case checks.
    • Documented requirements for including harness scenarios or golden cases with new orchestration features.
    • Updated the repository layout with dynamic-workflow test cases and catalog documentation.

Point readers at skills/codex-graph/testcases/ and
docs/dynamic-workflow-testcase-catalog.md from the surfaces they already
use: the Validate section (suite scope was stale: it predated the
testcase suite and topology-hint lint), the regression-coverage
contribution rule, and the repository layout index. Pure cross-links;
no behavior, checker, or CHANGELOG changes.
@coderabbitai

coderabbitai Bot commented Aug 9, 2026 •

Copy link
Copy Markdown

Review Change Stack

📝 Walkthrough

Walkthrough

Changes

Regression documentation

Layer / File(s) Summary
Regression and golden-case documentation
README.md
The README documents expanded regression checks, dynamic-workflow golden cases, offline harness commands, coverage requirements, and related repository paths.

Estimated code review effort: 1 (Trivial) | ~5 minutes

Possibly related PRs

  • jnyross/codex-graph#16: Introduces the dynamic-workflow golden-case and regression infrastructure documented by this PR.
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly identifies the README documentation change that cross-links dynamic-workflow test cases.
Description check ✅ Passed The description explains the documentation changes, validation performed, and why no regression case was added for this docs-only change.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch docs/cross-link-testcases

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Open in Devin Review

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@README.md`:
- Around line 82-86: Update the README description of
skills/codex-graph/testcases/ to identify the offline harness as shared and
located under the testcases/harness/ directory, rather than implying each case
directory contains its own harness. Preserve the description of the six golden
cases and their bundled files.
🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: ba62bf25-fbe3-478a-9c1a-90046fb77e1e

📥 Commits

Reviewing files that changed from the base of the PR and between 2dba22a and 20604ac.

📒 Files selected for processing (1)
  • README.md

Comment thread README.md
Comment on lines +82 to +86
`skills/codex-graph/testcases/` holds six golden cases derived from real
orchestration shapes. Each case bundles a synthetic `GOAL.md`, a
machine-checkable `EXPECTATIONS.md`, and a `topology.hint.mmd`, plus an
offline harness that can statically check a generated `workflow.js` against a
case:

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

Describe the offline harness as shared.

The command below places check_workflow.js under skills/codex-graph/testcases/harness/, not under each case directory. Revise this sentence so readers do not search for a harness inside every cases/<id>/ directory.

Proposed wording
-Each case bundles a synthetic `GOAL.md`, a
-machine-checkable `EXPECTATIONS.md`, and a `topology.hint.mmd`, plus an
-offline harness that can statically check a generated `workflow.js` against a
-case:
+Each case bundles a synthetic `GOAL.md`, a
+machine-checkable `EXPECTATIONS.md`, and a `topology.hint.mmd`. The shared
+offline harness can statically check a generated `workflow.js` against a case:
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
`skills/codex-graph/testcases/` holds six golden cases derived from real
orchestration shapes. Each case bundles a synthetic `GOAL.md`, a
machine-checkable `EXPECTATIONS.md`, and a `topology.hint.mmd`, plus an
offline harness that can statically check a generated `workflow.js` against a
case:
Each case bundles a synthetic `GOAL.md`, a
machine-checkable `EXPECTATIONS.md`, and a `topology.hint.mmd`. The shared
offline harness can statically check a generated `workflow.js` against a case:
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@README.md` around lines 82 - 86, Update the README description of
skills/codex-graph/testcases/ to identify the offline harness as shared and
located under the testcases/harness/ directory, rather than implying each case
directory contains its own harness. Preserve the description of the six golden
cases and their bundled files.

@jnyross
jnyross merged commit 5b8cd8d into main Aug 9, 2026
4 checks passed
@jnyross
jnyross deleted the docs/cross-link-testcases branch August 9, 2026 20:38
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant