Repository navigation

fix(evals): judge invocation-probe runs by their measured rate in run-validity - #11639

Merged

kyle-sexton merged 4 commits into

mainfrom

fix/11618-probe-run-validity

Oct 31, 2026

Merged

fix(evals): judge invocation-probe runs by their measured rate in run-validity#11639
kyle-sexton merged 4 commits into
mainfrom
fix/11618-probe-run-validity

Commits on Oct 31, 2026
- fix(evals): judge invocation-probe runs by their measured rate in run-validity
  
  kyle-sexton
  and
  claude
  committed
  19220a4
- Merge branch 'main' into fix/11618-probe-run-validity
  kyle-sexton
  authored
  5ea905e
- fix(evals): exempt a probe's trace only when every error is the turn cap
  
  kyle-sexton
  and
  claude
  committed
  ea154fa
- fix(evals): waive a probe's turn cap only after the graded skill call
  
  kyle-sexton
  and
  claude
  committed
  50a64e2