feat(signals): slop golden-fixture + determinism coverage and documented thresholds (#565) - #967
Conversation
…ted thresholds (JSONbored#565) Adds golden-fixture coverage of buildSlopAssessment across all four bands (clean/low/elevated/high) with exact slopRisk, band, and finding codes, plus an explicit determinism check (identical metadata -> identical slopRisk + findings), and documents the band thresholds on slopBandFor. Per the issue's acceptance (documented thresholds; identical metadata -> identical slopRisk). Weights are intentionally left unchanged: the golden fixtures show the current weights already separate every band cleanly, so no retuning is warranted. Closes JSONbored#565.
|
🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 🛠️ Maintainer review — Held for maintainer reviewReviewed 2 changed file(s) — two independent AI reviewers, synthesized. ✅ Safe to merge — both reviewers found no blocking issues.
Merge readiness: ✅ Mergeable · all CI checks green/neutral/skipped. Summary The change adds documentation comments describing deterministic slop risk bands and expands unit tests to verify band mapping and determinism. No functional code changes alter behavior, security, or public output. Tests ensure forbidden public terms are not emitted. All existing CI checks are presumed green. 💡 Nits — non-blocking, optional
|
|
Note Gittensory Gate skippedPR closed before full evaluation. No late first comment was created.
💰 Earn for open-source contributions like this. Gittensor lets GitHub contributors earn for the work they already do — register to start earning →. Checked by Gittensory, a quiet PR intelligence layer for OSS maintainers. |
|
Superagent didn't find any vulnerabilities or security issues in this PR. |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #967 +/- ##
=======================================
Coverage 96.60% 96.60%
=======================================
Files 110 110
Lines 15069 15069
Branches 5445 5445
=======================================
Hits 14558 14558
Misses 107 107
Partials 404 404 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
ghost
left a comment
There was a problem hiding this comment.
Held for maintainer (guardrail_area) — correct + CI green
Summary
Addresses #565. Adds golden-fixture coverage of
buildSlopAssessmentacross all four bands (clean / low / elevated / high) — each fixture pins the exactslopRisk,band, and sorted finding codes — plus an explicit determinism check (identical metadata → identicalslopRisk+findings), and documents the band thresholds onslopBandFor.Acceptance
Matches the issue's acceptance: documented thresholds; identical metadata → identical slopRisk.
Weights unchanged (intentional)
The golden fixtures demonstrate the current
SLOP_WEIGHTSalready separate every band cleanly (15 → low, 30 → elevated, two strong = 60 → high), so no retuning is warranted; keeping the weights stable preserves the deterministic contract both the MCP tool and CI consume.Tests
npx vitest run test/unit/slop.test.ts→ 42 passed ·npx tsc --noEmit→ clean ·git diff --check→ clean.Closes #565.