Skip to content

ai-slop: check whether any shipped rule appears under Wikipedia's "Ineffective indicators" #3032

Description

@kyle-sexton

Graduated from the contract slice of #3031 (docs/topics/ai-slop-unslop-integration/PLAN.md), pruned before merge per the topic-docs convention.

What

plugins/ai-slop/skills/audit/reference/catalog.md records two sections of its source page as a known fetch gap: "Comment-specific indicators" and "Ineffective indicators". The second one is the load-bearing half.

"Ineffective indicators" lists signals that page's own editors consider unreliable for detection. Our catalog cites that page as its source. If a rule we ship appears in that section, we are shipping a rule our own cited source classifies as ineffective — which is a guardrail question, not a completeness one.

The two candidates, both by our own records:

  • rule-em-dash — zero-tolerance by design, and measured at 34,999 matching lines on this repo alone.
  • rule-rule-of-three — the catalog's own calibration record calls it "highest false-positive risk in the roster".

Why it is not already answered

A /discovery:research pass attempted it and was blocked: every Wikimedia host is denied at the research environment's egress gateway (a network policy, not a tool-permission setting). Routing through a third-party read-proxy was deliberately declined as circumventing the denial rather than researching around it. Seven hosts and routes were checked and recorded.

What closes this

One fetch from a session with Wikimedia egress:

  1. Fetch the current revision of Wikipedia:Signs of AI writing; record its revision id and date.
  2. Read the "Ineffective indicators" section. Report whether any of detect.sh's 15 shipped rules appears there.
  3. If one does: that is a rule-disposition decision, not a doc edit — bring it back as such.
  4. If none does: record the section as checked in the catalog's upstream-drift record and close the fetch gap for that half.

The "Comment-specific indicators" half is lower value — its scope is Wikipedia talk-page comments, and secondary evidence suggests it duplicates rule-verbose-edit-summaries and rule-canned-policy-assurance, which the catalog already carries. Worth doing in the same visit, not worth its own.

Our pin is revision 1369699198 (2026-08-16), and the page was measured at 50+ edits/week, so expect meaningful drift.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions