Skip to content

[deep-report] Strip bot-footer signatures from prompt-clustering text cleaning before vectorization #56890

Description

@github-actions

Description

The Prompt Clustering Analysis workflow's clean_prompt() helper (around line 380 of the workflow .md) strips markdown code blocks, START COPILOT preambles, URLs, and special characters — but doesn't strip recurring bot-footer signatures embedded in PR bodies before TF-IDF vectorization. This cycle's Prompt Clustering Analysis — 2026-08-29 run flagged its own Cluster 1 as an artifact: 63 PRs (5.5% of the 1,140 analyzed) clustered together purely because of a repeated "PR Sous Chef ... Comment /souschef to run again" bot footer, not a coherent task theme. The same class of noise likely affects other bot-authored footers (e.g. <!-- gh-aw-agentic-workflow: ... --> HTML comments).

Expected Impact

Strips noise before vectorization so cluster assignments reflect actual task content rather than bot signatures — removing at least one full noise cluster (currently ~5.5% of all analyzed PRs) and improving keyword/theme accuracy for the remaining clusters.

Suggested Fix

In clean_prompt(), add a stripping step (before or alongside the existing markdown-code-block removal) for:

  • <!--\s*gh-aw-agentic-workflow:.*?--> style HTML comment footers
  • Known recurring bot-footer text patterns (e.g. "PR Sous Chef", "Comment /souschef to run again") — ideally via a small, extensible list/regex rather than one-off string matches, since new bot footers will appear over time.

Suggested Agent

prompt-clustering-analysis workflow author / New Agent

Estimated Effort

Quick (< 1 hour)

Data Source

DeepReport Intelligence Briefing analysis, 2026-08-29 cycle (window: discussions #56860#56877, since prior baseline #56856). Source discussion: "Prompt Clustering Analysis - 2026-08-29" (#56873).

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • api.anthropic.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "api.anthropic.com"

See Network Configuration for more information.

Generated by 🔬 Deep Report · claude · agent · 84.7 AIC · ⌖ 7.69 AIC · ⊞ 12.4K ·

  • expires on Aug 31, 2026, 4:37 AM UTC-08:00

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions