Parent roadmap: #525
Parent phase: #529
Background
A static rubric can be gamed and never improves. Calibrating slop and recommendation quality against real outcomes is the durable moat. This builds on the (closed) #278 outcome-learning infra rather than reopening it.
Goal
Log slop assessments + recommendations and calibrate against real merged-vs-closed-vs-stale outcomes.
Current Behavior
recommendation-outcomes.ts and outcome dimensions exist (#278 shipped), but slop is not yet calibrated against outcomes.
Desired Behavior
- Lightweight telemetry first: a
slop_assessment_events table correlated with PR outcomes.
- Graduate to periodic calibration of
SLOP_WEIGHTS and recommendation ranking from observed outcomes.
Implementation Requirements
Public/Private Output Boundaries
- Telemetry is internal; never surfaced publicly; no wallet/reward/trust fields.
Acceptance Criteria
- Assessments + outcomes are recorded; a calibration job can adjust weights deterministically and reproducibly.
Testing Requirements
npm run test:ci, 97%+ coverage. Telemetry-privacy tests + deterministic calibration test.
Parent roadmap: #525
Parent phase: #529
Background
A static rubric can be gamed and never improves. Calibrating slop and recommendation quality against real outcomes is the durable moat. This builds on the (closed) #278 outcome-learning infra rather than reopening it.
Goal
Log slop assessments + recommendations and calibrate against real merged-vs-closed-vs-stale outcomes.
Current Behavior
recommendation-outcomes.tsand outcome dimensions exist (#278 shipped), but slop is not yet calibrated against outcomes.Desired Behavior
slop_assessment_eventstable correlated with PR outcomes.SLOP_WEIGHTSand recommendation ranking from observed outcomes.Implementation Requirements
Public/Private Output Boundaries
Acceptance Criteria
Testing Requirements
npm run test:ci, 97%+ coverage. Telemetry-privacy tests + deterministic calibration test.