Skip to content

risk-control actuation: calibrated λ̂ governs the gate under an explicit precedence rule #8849

Description

@JSONbored

Context

#8848 shipped the risk-control calibration (#8835): daily fixed-sequence recalibration publishes a certified per-arm λ̂ to system_flags (riskcontrol:close / riskcontrol:merge) with the guarantee statement in the audit trail, refusing and retracting when under-powered. Two pieces were deliberately split out because they hinge on a precedence decision:

The decision this issue exists for: ai_review_close_confidence already has an automatic writer — the backtest-gated knob loosening (#8121/#8158, tunables_overrides via getAiReviewCloseConfidenceOverride). Wiring the calibrated λ̂ into the live gate floor creates two automatic writers on one knob. Options:

  1. Risk-control wins when calibrated (recommended): a human-label-backed finite-sample guarantee outranks a backtest-derived loosening; the knob-loosening writer is suspended for the arm while a λ̂ is published, resuming automatically on retraction. Rationale: the loosening optimizes throughput under a backtest proxy; λ̂ bounds real error against human ground truth.
  2. Max-of-both: act only when confidence clears BOTH floors — safest, but the loosening becomes dead code while calibrated.
  3. Keep consult-only forever — rejected by the epic's goal; the guarantee must eventually govern.

Requirements

Test Coverage Requirements

99%+ patch coverage, branch-counted, both arms of every conditional.

Expected Outcome

The certified threshold actually governs the gate under an explicit, documented precedence rule, and the homepage claim upgrades from empirical to guaranteed while — and only while — the guarantee is live.

Metadata

Metadata

Assignees

Labels

maintainer-onlyOwner-only work — yields no Gittensor points.

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions