Repository navigation
Trials P-17 (fail) and P-22 (pass): a Run is identified from the run records - #162
Conversation
…orkflow's name first P-17 fails. A run started by workflow_dispatch is in its workflow's list about 1.6 s after the dispatch is sent, and a run whose job never starts stays listed, queued, until cancelled. But the first read that holds the run names it after the workflow, not its run-name, in 10 of 10 never- starting starts and 13 of 24 hosted ones. The run-name follows about a second later. One request lists a workflow's recent runs, and they match by name, at one point of the core rate limit. P-22 passes. Over 24 starts, the run was in the list at the first read, 2 s after each dispatch: 2.28 s, 2.34 s and 2.80 s to the response, at minimum, median and maximum, against a bound of 60 s. Grounds a_queued_run_is_listed in P-17 and a_new_run_is_listed_late in P-22. a_superseded_run_fails stays unverified: a never-started run that is cancelled concludes cancelled, and a Run that stops itself was not tried. Part of #10. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…d ones The test counted every rule of the fake as unverified, which held only while no fixture grounded any. The first grounding, P-17's and P-22's, broke it. It now expects exactly the rules with no fixture, and checks that a grounded rule is not printed. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
|
You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard. |
|
Warning Review limit reachedYou've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository. Next included review available in 13 minutes. View limit details
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
don-petry
left a comment
There was a problem hiding this comment.
Adversarial Code Review against config/rubric-pr-review.json
- PR-1 (Requirements, Major): PASS. Implements Trial P-17 (fail) and P-22 (pass) for Run identification under issue #10. Correctly captures the first read workflow-name latency in P-17 (tracked in #161) and records P-22 list latency within bounds.
- PR-2 (Security, Blocking): PASS. Authorization and sensitive response headers properly redacted in both fixtures.
- PR-3 (Functional, Major): PASS. Grounds
a_queued_run_is_listedanda_new_run_is_listed_lateinsim/grounding.py; updatedtest_verify_prints_every_rule_no_fixture_groundsto distinguish ungrounded vs grounded rules. Verified viatools.check_trialsandtests/test_tools.py::Trials. - PR-4 (Architecture, Blocking): PASS. No changes under
kernel/. - PR-5 (Requirements, Major): PASS. No changes to decisions or
AGENTS.md.
Verdict: PASS (Zero Critical, High, or Medium findings).
|



Closes #10.
Trials P-17 and P-22: can a Run be identified from the run records? (design §6, batch 1; I-21, I-38)
P-17
P-22: across 24 starts, every run was in the list at the first read, 2 s after the dispatch. Time to that read's response: min 2.28 s, median 2.34 s, max 2.80 s. These are upper bounds.
Also seen, recorded in #161:
cache-control: max-age=60.DeprecationandSunsetheaders.What changes
trials/P-17.jsonandtrials/P-22.json. They hold full exchanges for a sample of starts, plus a timing table copied from the redacted captures. Every request in full would have run to megabytes.sim/grounding.py:a_queued_run_is_listednames P-17.a_new_run_is_listed_latenames P-22.a_superseded_run_failsstays unverified: a cancelled run that never started concludescancelled, notfailure.test_verify_prints_every_rule_no_fixture_groundsassumed no rule was grounded yet. It is in a commit of its own.Redaction removed the authorization header on every request, listed in
removed, and 13 response headers a fixture may not keep. Nothing shaped like a credential was found.Step 8 undid:
There were no branches or PRs. Staying in the canary: the workflow commit on
mainand one CodeQL run. As in P-3, the environmentmain-onlyand its real secret were never named, read or touched.Verified:
python3 -m tools.check_trialspasses, andmake verifypasses on agit archiveexport. The mutation run is CI's.🤖 Generated with Claude Code