Skip to content

t27c test-report: count executed asserts and flag vacuous passes (sieve C10, T730) #6509

Closed

Description

@gHashTag

t27c test-report: count the asserts each passing test executes, and mark zero-assert passes as vacuous.

Context (epic #6488, sieve filter C10, theorem T730 in specs/compiler/theory/toolchain.t27; Beer, Ben-David, Eisner, Rodeh, CAV 1997, "vacuous pass"):

  • t27b already separates pass_vacuous (a pass that executed 0 runtime asserts, t27b: per-spec ratchet ledger + vacuous-pass count, so the coverage number can only move visibly #6115). On the lab (master 682564f) that is 281 of the 661 t27b passes.
  • t27c test-report prints pass/FAIL per test with no assert count, so the reference path cannot tell a checked pass from an empty one. In the sieve this is the one filter t27b passes and t27c fails.
  • T730: a pass certifies something only if the trivial backend (compile every test to "return") would fail it, i.e. only if at least one assert ran.

Done when t27c test-report reports, per test, the number of asserts executed, and a summary line of vacuous passes; the suite and the lab can then count checked coverage the same way on both paths.

Owner: agent C (Compiler Core).

Refs #6488

Boundary

  • specs/compiler/theory/toolchain.t27

Activity

  1. added
    owner-approved-foreignOwner-approved exception to the only-t27 rule: hand-written foreign code allowed in this PR
    on Oct 6, 2026
  2. added
    needs-boundaryNo '## Boundary' section, so the Queen can reserve nothing for it and no bee can take it
    and removed
    needs-boundaryNo '## Boundary' section, so the Queen can reserve nothing for it and no bee can take it
    on Oct 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    owner-approved-foreignOwner-approved exception to the only-t27 rule: hand-written foreign code allowed in this PR

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions