Skip to content

Design spec: similarity/containment detection algorithm for plagiarism/copycat detection (#1969) #5746

Description

@JSONbored

Problem: #1969 (plagiarism/copycat detection, effort: XL) has shipped only its first slice — PR #4140 added the gate.copycat.mode config scaffold, explicitly deferring "the actual detection engine (which carries real false-accusation risk and needs careful design)" to a documented follow-up. That design has not been scoped as its own issue yet, and #1969 itself has no design artifact to implement against.

Area: ORB / anti-slop

Proposal: Produce a concrete design for the similarity/containment scoring algorithm #1969 needs: what "containment" is measured against (repo history window, cross-PR corpus, or both), the actual scoring method (n-gram/AST-fingerprint/embedding-similarity — with a stated false-positive-rate target), the direction-by-timestamp attribution logic (earlier submission = victim) for edge cases (near-simultaneous submissions, forked lineage), and how the tiered response (warn → label → block → strikes) maps to concrete score thresholds. This is a maintainer-only design pass precisely because a wrong call here produces a false plagiarism accusation against a real contributor — the same reasoning gate.copycat.mode's own scaffold PR used to defer this exact piece.

Deliverables:

  • A written design spec: algorithm choice + justification, false-positive-rate target and how it's measured pre-launch, attribution-direction edge case handling, and threshold-to-tier mapping.
  • Explicit sign-off before any detection-engine implementation issue is filed/decomposed from Plagiarism / copycat detection #1969.

Acceptance criteria:

  • The design spec is reviewed and approved by the maintainer before implementation work begins.
  • The false-positive-rate target and its measurement method are stated concretely (not "low false positives" — an actual number/method).

Resources:

Boundaries:

  • Design only — no detection-engine implementation in this issue. Implementation should be filed as a fresh, decomposed issue (or issues) once this design is approved.

Part of #1969.

Metadata

Metadata

Assignees

Labels

maintainer-onlyOwner-only work — yields no Gittensor points.orbGittensory Orb related - maintainer self-hosting analytics.roadmapOn the Wave-2 agent-layer roadmap board (project 9)

Projects

Status
Done

Relationships

None yet

Development

No branches or pull requests

Issue actions