Skip to content

Support parallelism on the test command - #803

Merged
jviotti merged 7 commits into
mainfrom
parallel-test
Aug 10, 2026
Merged

jviotti merged 7 commits into
mainfrom
parallel-test

Conversation

@jviotti

@jviotti jviotti commented Aug 5, 2026

Copy link
Copy Markdown
Member

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Review in cubic

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@jviotti jviotti changed the title [WIP] Support parallelism on the test command Support parallelism on the test command Aug 10, 2026
@jviotti
jviotti marked this pull request as ready for review August 10, 2026 13:54
@augmentcode

augmentcode Bot commented Aug 10, 2026

Copy link
Copy Markdown
🤖 Augment PR Summary

Summary: This PR adds configurable parallel execution to the jsonschema test command.

Changes:

  • Enables Core's parallel module and links it into the CLI target.
  • Adds --jobs/-J <count> to CLI parsing, Bash/Zsh completion, help, and test documentation.
  • Defaults job selection to the system hardware-concurrency value and validates explicit job counts.
  • Pre-warms configuration and resolver caches before dispatching test suites to workers.
  • Refactors text and CTRF reporting into per-suite execution helpers.
  • Aggregates CTRF suite reports after worker completion to retain deterministic report assembly.
  • Captures worker exceptions and rethrows the first observed failure after parallel processing.
  • Adds coverage for invalid job values, multi-job pass/fail cases, JSON reports, empty suites, configurations, and parse errors.

Technical Notes: Parallel text output is synchronized to avoid interleaved suite reports; documentation notes ordering, memory, and diagnostic-output considerations.

🤖 Was this summary useful? React with 👍 or 👎

@augmentcode augmentcode Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread src/command_test.cc Outdated

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reported issues were addressed across 22 files

Reply with feedback, questions, or to request a fix.

Re-trigger cubic

Comment thread test/test/pass_multi_jobs_json.sh
Comment thread test/test/fail_tests_empty_jobs.sh
Comment thread src/command_test.cc Outdated
Comment thread completion/jsonschema.bash
Comment thread test/test/fail_multi_jobs.sh
Comment thread docs/test.markdown
Comment thread test/test/fail_multi_jobs_parse_error.sh
Comment thread test/test/pass_multi_jobs_two_configurations.sh
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reported issues were addressed across 45 files (changes from recent commits).

Tip: Review your code locally with the cubic CLI to iterate faster.

Re-trigger cubic

Comment thread test/test/pass_jobs_verbose.sh Outdated
Comment thread src/command_test.cc
Comment thread completion/jsonschema.zsh Outdated
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@jviotti
jviotti merged commit 40bff94 into main Aug 10, 2026
16 checks passed
@jviotti
jviotti deleted the parallel-test branch August 10, 2026 15:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant