You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Outcome:regression — at least one held-out case regressed.
Report-only (Phase 1): a regression does not fail CI or block any merge.
skill
score
passed
failed
total
pr-review
0.5833333333333334
7
5
12
Regressed cases
deep-auth-session-rework — expected {"decision":"escalate","risk":"HIGH","escalate_to_opus":true,"key_findings":["touches authentication/session-token handling under src/auth/**, a HIGH-risk area that must escalate to the security auditor regardless of how clean the diff looks"]}, got null
deep-boundary-refactor-escalate — expected {"decision":"escalate","risk":"MEDIUM","escalate_to_opus":false,"key_findings":["decision gate 7 fails: the change crosses module boundaries and alters system shape, so deep review escalates for human and architectural review even though every other gate is green","the correct reason code is boundary-refactor, not poorly-structured — the PR is well structured; it escalates on structural-change grounds, not quality grounds","risk stays MEDIUM and the security-audit tier is not required — no high-risk area or anti-pattern is touched"]}, got null
Activity