Skip to content

feat(skills): add nemoclaw-maintainer-close-superseded-issues skill - #3525

Closed
cjagwani wants to merge 2 commits into
mainfrom
ship-skill-close-superseded-issues
Closed

cjagwani wants to merge 2 commits into
mainfrom
ship-skill-close-superseded-issues

Conversation

@cjagwani

@cjagwani cjagwani commented May 14, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Closes a batch of superseded issues with evidence-bearing comments and audit trail. Reads a JSON sidecar from find-already-fixed or scope-issues and applies a 3-step sequence per issue (assignee, evidence comment, close).

Behavior

  • Local-only by default — drafts only, never posts to GitHub.
  • Emits a JSON sidecar (/tmp/nemoclaw-skill-output-close-superseded-issues-<run_id>.json) for chaining with sibling maintainer skills in the suite.

Conformance audit — Claude Agent Skills best practices

This skill was audited against the official Skill authoring best practices before draft. Per-item evidence:

Core quality

Item Status Evidence
Description specific + key terms ✓ description is 541 chars (under 1024 cap), first word Closes (third-person, per spec)
Description has WHAT + WHEN ✓ Explicit Use when… trigger phrase present in the description
SKILL.md body under 500 lines ✓ Currently 222 lines (44%)
Additional details in separate files ✓ Supporting files: MULTI-MODEL-TESTING.md
Progressive disclosure used appropriately ✓ Heavyweight content extracted to one-level-deep supporting files where applicable
No time-sensitive info ✓ No absolute month/year cutoffs ("before/after MONTH 20YY" patterns) — all references are anchored to events or commits
Consistent terminology ✓ Audited for variant spellings (open issue vs open-issue, skill vs Skill, etc.)
Examples are concrete ✓ 3 real PR/issue references in SKILL.md: #3268, #3280, #3418
File references one level deep ✓ All supporting files linked directly from SKILL.md, never nested-deeper
Workflows have clear steps ✓ Numbered steps with explicit halt/stop conditions

Code and scripts

Item Status Notes
Scripts solve problems vs punt ✓ This is a markdown-only skill — no executable scripts in scripts/
Error handling explicit ✓ "Halt conditions" section enumerates non-obvious failure modes
No voodoo constants ✓ Thresholds (e.g. --min-confidence 0.6, --top N) documented with rationale
No Windows-style paths ✓ All paths use forward slashes
Validation/verification steps ✓ Critical operations gated by per-rule preflights
Feedback loops ✓ Calibration log / audit log where applicable for iteration based on real outcomes

Testing

Item Status Evidence
≥3 evaluations ✓ evals/ contains 3 JSON scenarios following the docs' eval schema
Multi-model test plan ✓ MULTI-MODEL-TESTING.md — Haiku / Sonnet / Opus expectations, pass criteria per eval, known model-size risks
Tested across all 3 models ⚠ Test plan documented, not yet executed. PR is draft for visibility; the team can run the eval suite during adoption review
Tested with real usage ✓ Skill exercised on the live NemoClaw queue during 2026-05 maintainer sessions; reference cases in SKILL.md

Frontmatter constraints (validated)

  • name: nemoclaw-maintainer-close-superseded-issues — under 64 chars, lowercase + hyphens, no reserved words ("anthropic" / "claude")
  • description: third-person verb-initial, under 1024 chars, no XML tags, includes explicit Use when… trigger

Notes for reviewers

Part of an 11-skill maintainer suite. Draft for visibility. The team's <10 open-PR policy means 6 are open and 5 are closed-but-branch-preserved; reopen via gh pr reopen <num> as slots free up.

🤖 Generated with Claude Code

Closes a batch of superseded issues with evidence-bearing comments.
Reads a JSON sidecar from find-already-fixed or scope-issues and
applies a 3-step sequence (assignee, evidence comment, close) gated
by per-rule preflights. Supports --revival-only for STALE_NO_REPRO
rows. Audit log to ~/.nemoclaw/close-audit.jsonl for postmortem
recoverability.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Signed-off-by: Charan Jagwani <cjagwani@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented May 14, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@coderabbitai

coderabbitai Bot commented May 14, 2026 •

Copy link
Copy Markdown
Contributor

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 7cdc19a7-1440-4f52-9aae-4e3fe6a4d1ce

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch ship-skill-close-superseded-issues

Comment @coderabbitai help to get the list of available commands and usage tips.

@github-actions

github-actions Bot commented May 14, 2026 •

Copy link
Copy Markdown
Contributor

E2E Advisor Recommendation

Required E2E: None
Optional E2E: cloud-inference-e2e

Dispatch hint: cloud-inference-e2e

Workflow run

Full advisor summary

E2E Recommendation Advisor

Base: origin/main
Head: HEAD
Confidence: high

Required E2E

  • None. No required E2E: the PR only adds agent skill markdown and eval JSON assets under .agents/skills. It does not modify NemoClaw runtime code, installer/onboarding paths, sandbox lifecycle, credentials, security policy, inference routing, deployment, or network policy. Existing E2E coverage for these runtime/user flows is not needed as a merge blocker.

Optional E2E

  • cloud-inference-e2e (medium; live install/onboard plus cloud inference): Optional confidence check only: test/e2e/test-cloud-inference-e2e.sh validates repo .agents/skills SKILL.md frontmatter/body via validate_repo_skills.sh, which would catch malformed skill metadata. It is not merge-blocking here because the PR changes skill/documentation/eval assets only and does not alter runtime behavior.

New E2E recommendations

  • agent-skill-evals (medium): No existing E2E appears to run .agents/skills//evals/.json against the corresponding SKILL.md. A lightweight validation could load the new close-superseded-issues eval sidecars and assert required behavior strings, sidecar field references, and safety/audit-log requirements are present.
    • Suggested test: Add a hermetic skill-eval validation job for .agents/skills/**/evals/*.json and SKILL.md consistency.
  • maintainer-issue-close-safety (medium): The new skill describes safety-critical GitHub issue actions such as comment-before-close, priority+QA confirmation, recent external comment skip, raced close handling, revival-only scheduling, and local audit logging. Existing NemoClaw E2E suites do not simulate this maintainer workflow with a mocked gh CLI.
    • Suggested test: Add a hermetic mocked-gh E2E or integration test for nemoclaw-maintainer-close-superseded-issues that verifies comment/close ordering, per-issue gates, race handling, revival-only behavior, and ~/.nemoclaw/close-audit.jsonl append semantics.

Dispatch hint

  • Workflow: .github/workflows/nightly-e2e.yaml
  • jobs input: cloud-inference-e2e

…issues

Adds the following to satisfy the Claude Agent Skills best-practices
checklist (https://platform.claude.com/docs/en/agents-and-tools/agent-skills/best-practices):

- Three evaluation scenarios in evals/ following the docs' eval schema
- Multi-model test plan in MULTI-MODEL-TESTING.md (Haiku / Sonnet /
  Opus expectations, pass criteria, known risks)
- Terminology normalized to single canonical form
- Concrete reference cases (real-but-anonymized examples) where the
  prior SKILL.md was abstract
- Progressive-disclosure splits where SKILL.md was approaching the
  500-line soft limit (issue-autopilot, scope-issues)

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Signed-off-by: Charan Jagwani <cjagwani@nvidia.com>
@jyaunches

Copy link
Copy Markdown
Contributor

Superseded by the NemoClaw team skills GitLab repository snapshot: https://gitlab-master.nvidia.com/jyaunches/nemoclaw-team-skills. Closing this PR so skill sharing continues in the dedicated team-skills repo instead of merging these skills into NemoClaw directly.

@jyaunches jyaunches closed this May 15, 2026
@wscurran wscurran added the feature PR adds or expands user-visible functionality label Jun 8, 2026
@cv
cv deleted the ship-skill-close-superseded-issues branch June 28, 2026 00:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature PR adds or expands user-visible functionality

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants