Repository navigation
gauntlet: tests/mods is never run; CLAUDE.md claims every test runs #448
Description
Found by the 2026-10-04 pstack attacker wave.
CLAUDE.md says the gauntlet runs "every test under tests/", but scripts/run-gauntlet.sh globs only tests/{hooks,skills,scripts,evals}. tests/mods/cost-ledger.test.ts (added in #446) is run only by claude plugin test, so no hook runs it. Same day, #443 and #446 merged 8 minutes apart, each green alone, and develop went red on the merge (fixed in #447).
Fix: run claude plugin test . in the gauntlet (validate layer) if it is stable under the benign-stub test and the load rules (#158); otherwise make the CLAUDE.md sentence true. Add a test that fails when a tests/<dir> exists that no layer runs.
Open question left to the operator: a merge-time check (there is no CI and no required status check).
Activity
Merge pull request #452 from wasikarn/claude/gauntlet-mods-tests-448
wasikarn commentedon Oct 4, 2026
Fixed in #452. tests/mods already ran in the tests layer through tests/hooks/test-cost-ledger-module.sh (claude plugin test), so CLAUDE.md's 'every test under tests/' was true. The wiring self-test now fails when any tests/
is run by no layer, mod tests included. The merge-time check question is still open.