Skip to content

Add operational-value grader for Daily Documentation Healer - #58454

Closed
mnkiefer with Copilot wants to merge 2 commits into
mainfrom
copilot/daily-doc-healer
Closed

Add operational-value grader for Daily Documentation Healer#58454
mnkiefer with Copilot wants to merge 2 commits into
mainfrom
copilot/daily-doc-healer

Conversation

Copilot AI commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Adds a deterministic operational-value contract for daily-doc-healer, measuring whether newly closed documentation defects receive accepted documentation-automation remediation.

  • Grader

    • Adds historical case reconstruction from closed, unresolved documentation issues.
    • Scores one absolute primary value: 1 for healthy/no-op or accepted remediation, 0 for an unresolved assigned issue, and null for unavailable evidence.
    • Freezes adoption provenance, baseline evidence, accepted PR criteria, and seven-day maturity.
  • Workflow

    • Registers the evaluator under graders.operational-value.
    • Regenerates the workflow lock file.
{
  "value": 1,
  "opportunityKey": "issue:42",
  "case": {"issue": 42}
}
Original prompt

[operational-value] daily-doc-healer

Use the operational-value-designer skill to add and verify one deterministic
operational-value grader for github/gh-aw workflow daily-doc-healer.

Requirements:

  • Recover adoption-time intent and pre-adoption evidence independently for this workflow. Do not copy Daily File Diet's metric or evidence contract.
  • If no direct operational metric can be defended from accepted repository evidence, stop and explain the blocker. Do not substitute execution quality, output volume, traces, or agent judgment.
  • Change only .github/workflows/daily-doc-healer.md, its generated lock file, .github/graders/daily-doc-healer-operational-value.sh, and reports/operational-value/daily-doc-healer-operational-value.{json,md,svg} unless a directly necessary test or documentation fix is required.
  • Preserve one absolute primary value in [0,1]. Keep diagnostics separate and treat missing evidence as null, never zero.
  • Support historical case reconstruction so pre-grader runs can be reported.
  • Do not edit source-managed workflow files or generated lock files by hand.

Validation and report:

  1. Run .github/skills/operational-value-designer/scripts/verify-operational-value-evaluator.sh .github/graders/daily-doc-healer-operational-value.sh
  2. Run gh aw compile .github/workflows/daily-doc-healer.md
  3. Run gh aw graders operational-value report daily-doc-healer --repo github/gh-aw
  4. Review the generated JSON, Markdown, and SVG for coverage failures or misleading aggregation before finishing.

Keep this pull request limited to one workflow so it can be reviewed and merged independently.

Co-authored-by: mnkiefer <8320933+mnkiefer@users.noreply.github.com>
Copilot AI changed the title [WIP] Add and verify deterministic operational-value grader for daily-doc-healer Add operational-value grader for Daily Documentation Healer Sep 4, 2026
Copilot AI requested a review from mnkiefer September 4, 2026 11:10
@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Category: feature | Risk: medium | Score: 54 (impact 32 + urgency 12 + quality 10) | Action: batch_review | Batch: operational-value-grading

Generated by 🔧 PR Triage Agent · copilot · mai10 · 22.2 AIC · ⌖ 2.85 AIC · ⊞ 15.1K ·

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Category: feature | Risk: medium | Score: 54 (impact 32 + urgency 12 + quality 10) | Action: batch_review | Batch: operational-value-grading

Generated by 🔧 PR Triage Agent · copilot · mai10 · 22.2 AIC · ⌖ 2.85 AIC · ⊞ 15.1K ·

@mnkiefer mnkiefer closed this Sep 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants