Skip to content

fix(gauntlet): name failing test files in the log tail (GH #387) - #399

Merged
wasikarn merged 2 commits into
developfrom
claude/gauntlet-failed-files-387
Oct 3, 2026
Merged

wasikarn merged 2 commits into
developfrom
claude/gauntlet-failed-files-387

Conversation

@wasikarn

@wasikarn wasikarn commented Oct 3, 2026

Copy link
Copy Markdown
Owner

What

  • run_hook_tests() collects every test file with a non-zero exit and prints failing: <files> after the layer's output.
  • The final gauntlet: FAILED message repeats that line, so the last lines of a CI log name the culprit.
  • New tests/scripts/test-gauntlet-failed-summary.sh.

Why

A red gauntlet log never named the failing file. One CI failure log ran to 3284 lines in 49 sections, and the runner's /tmp, where the full logs are kept, is gone after the job.

Proof

  • New test extracts run_hook_tests() with hook_test_files() stubbed to one passing and one failing fixture, and runs the script's closing if-block on a fixture log. Red before the fix (2/4 failed), green after (4/4).
  • Mutation check: restored the original script, the test went red again; re-applied the fix, green.
  • Exit codes are unchanged. bash 3.2 only (space-joined string, no arrays).
  • test-run-gauntlet-wiring.sh and test-gauntlet-log-preservation.sh pass.
  • audit.sh: 0 CRIT. run-gauntlet.sh: all layers passed.

Closes #387

@wasikarn
wasikarn merged commit 118d223 into develop Oct 3, 2026
3 checks passed
@wasikarn
wasikarn deleted the claude/gauntlet-failed-files-387 branch October 3, 2026 15:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

gauntlet: print which test files failed

1 participant