Skip to content

feat(learning): calibrate slop & recommendations vs merge outcomes #543

Description

@JSONbored

Parent roadmap: #525
Parent phase: #529

Background

A static rubric can be gamed and never improves. Calibrating slop and recommendation quality against real outcomes is the durable moat. This builds on the (closed) #278 outcome-learning infra rather than reopening it.

Goal

Log slop assessments + recommendations and calibrate against real merged-vs-closed-vs-stale outcomes.

Current Behavior

recommendation-outcomes.ts and outcome dimensions exist (#278 shipped), but slop is not yet calibrated against outcomes.

Desired Behavior

  • Lightweight telemetry first: a slop_assessment_events table correlated with PR outcomes.
  • Graduate to periodic calibration of SLOP_WEIGHTS and recommendation ranking from observed outcomes.

Implementation Requirements

Public/Private Output Boundaries

  • Telemetry is internal; never surfaced publicly; no wallet/reward/trust fields.

Acceptance Criteria

  • Assessments + outcomes are recorded; a calibration job can adjust weights deterministically and reproducibly.

Testing Requirements

  • npm run test:ci, 97%+ coverage. Telemetry-privacy tests + deterministic calibration test.

Metadata

Metadata

Assignees

No one assigned

    Labels

    gittensor:featureGittensor-scored feature linked to a feature issue — scores a 0.25x multiplier.

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions