docs(miner-selfimprove): self-improve phase design note — calibration, value-weighting, anti-farming boundaries (#4265) - #4471
Conversation
…, value-weighting, anti-farming boundaries (JSONbored#4265) Add packages/gittensory-miner/docs/miner-selfimprove-calibration.md documenting, for a contributor who only has Phase 7's contributor-safe tools, WHERE the read-only-measurement / maintainer-only-enforcement line is and why: - What calibration measures: the Phase7CalibrationLoopResult contract combining historical_replay + pr_outcome against the documented 0.62 baseline, and computeGateEval's confusion matrix (GateEvalRow, mergeFalse = the dangerous error) as the ground truth. - Value-weighting: why weighted precision (REVERSAL_DISCOUNT_WEIGHT, currently 0) measures DURABLE correctness, not volume — a reverted merge earns no credit. - The maintainer-only line: personalized tuning (JSONbored#2349), fleet anti-farming (JSONbored#2350), and calibration-gated circuit-breaking (auto-tune.ts hold-only breaker, JSONbored#2352) — and why every contributor-safe tool is read-only/local-only BECAUSE a write-capable version would be a farming vector. - An explicit 'what this phase does NOT do' section (no autonomy/threshold changes, no writes to maintainer-owned calibration/circuit-breaker state). Prose design note under docs/ (matching the coding-agent-driver.md / cross-repo- discovery-phase1.md convention); cross-links JSONbored#2348/JSONbored#2349/JSONbored#2350/JSONbored#2352 for context without reopening them. Every referenced symbol verified against the source. Closes JSONbored#4265
|
Superagent didn't find any vulnerabilities or security issues in this PR. |
|
Tip 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 ✅ Gittensory review result - approve/merge recommendedReview updated: 2026-07-09 21:05:02 UTC
✅ Suggested Action - Approve/Merge
Review summary Nits — 4 non-blocking
Review context
Contributor next steps
Signal definitions
🟩 Safe / merged · 🟦 Advisory · 🟨 Held for review · 🟥 Blocked / closed 💰 Earn for open-source contributions like this. Gittensor lets GitHub contributors earn for the work they already do — register to start earning →. Checked by Gittensory, a quiet PR intelligence layer for OSS maintainers.
|
Adds
packages/gittensory-miner/docs/miner-selfimprove-calibration.md— the Phase 7 self-improve design note, written for a contributor who has only the contributor-safe tools (drift detector, calibration dashboard, prediction ledger, metrics exporter, extension panel, regression tests) and needs to understand where the read-only-measurement / maintainer-only-enforcement line is and why.Covers the five required points
Phase7CalibrationLoopResultcontract combininghistorical_replay+pr_outcomeagainst the documented0.62baseline, andcomputeGateEval's confusion matrix (GateEvalRow;mergeFalse= the dangerous error) as ground truth.REVERSAL_DISCOUNT_WEIGHT, currently0) measures durable correctness, not volume: a reverted merge earns no credit; the denominator is unchanged.auto-tune.ts's existing hold-only breaker (only ever more cautious, never loosens); enforcement stays maintainer-only.Plus an explicit "what this phase does NOT do" section (no autonomy-level or gate-threshold changes; no writes to maintainer-owned calibration/circuit-breaker state) and cross-links to #2348/#2349/#2350/#2352 for context (not to be reopened).
Accuracy
Prose design note under
docs/(matching thecoding-agent-driver.md/cross-repo-discovery-phase1.mdconvention). Every referenced symbol —DOCUMENTED_CALIBRATION_BASELINE,GateEvalRow,REVERSAL_DISCOUNT_WEIGHT, the auto-tune hold-only breaker — verified against the source; relative links resolve;docs:drift-checkstays green (prose isn't a tracked surface).Closes #4265