Add test improvement agent

[strawgate]

The agent identifies under-tested code areas, generates test cases, and opens PRs. It also identifies duplicate and useless tests and fixes or removes them.

It does not do large refactors focusing on point improvements

[github-actions]

tl;dr: Recommend adding a new scheduled GitHub agent workflow (shim + prompt) modeled on small-problem-fixer to open focused test-improvement PRs and update the workflow lists; there is no existing test-improvement workflow and this repo itself has no test suite to validate behavior.

Recommendation
Create a new gh-aw workflow (rwxp) that targets under-tested areas, generates minimal tests, and de-duplicates obvious test cases, then opens a single PR per run; update the workflow lists and compile. If Claude composite actions also need parity, add one only if the new agent requires different permissions/triggers than existing workflows (per claude-workflows/DEVELOPING.md guidance).

Findings

• New workflows are added via a shim in gh-agent-workflows/ plus a prompt in gh-agent-workflows/gh-aw-workflows/, then compiled (gh-agent-workflows/DEVELOPING.md lines 5-41, 138-144).
• small-problem-fixer is a scheduled, PR-creating workflow you can mirror for permissions/schedule and safe-output usage (gh-agent-workflows/small-problem-fixer.md lines 1-23; gh-agent-workflows/gh-aw-workflows/small-problem-fixer-rwxp.md lines 1-36).
• PR creation constraints live in gh-agent-workflows/gh-aw-fragments/safe-output-create-pr.md lines 1-15 (commit required, size/file limits, no .github/workflows edits).
• Workflow lists to update: gh-agent-workflows/README.md lines 5-18 and root README.md lines 14-24.
• Related search: no matching PRs; issue search for "test improvement agent" only returned this issue and an unrelated docs review issue.
• Repo appears to have no test files (glob for *test* only matched .github/workflows/smoke-test-install.yml), so validation must be based on downstream repos.

Verification

Not run — there is no test suite in this repository and this is a new workflow addition.

Detailed Action Plan

1. Create prompt file gh-agent-workflows/gh-aw-workflows/test-improvement-rwxp.md, modeled on small-problem-fixer-rwxp.md (lines 1-36). Include imports for elastic-tools, formatting, rigor, mcp-pagination, messages-footer, and safe-output-create-pr.
   • In the prompt: instruct the agent to discover the repo’s test command(s) (README/Makefile/package configs), run coverage if available, identify under-tested code via coverage gaps or heuristics (recent changes without tests, public APIs), and generate minimal tests.
   • Add a pass to detect duplicate/near-duplicate tests (name/structure or identical assertions) and remove/merge them when safe.
   • Enforce constraints: one PR max, no large refactors, skip if changes exceed safe-output limits.
2. Create shim gh-agent-workflows/test-improvement.md, mirroring schedule/permissions from small-problem-fixer.md (lines 1-23), but choose a less frequent schedule if tests are heavy (e.g., weekly + workflow_dispatch). Import the new prompt and allow noop when no safe, focused improvement exists.
3. Update workflow lists in gh-agent-workflows/README.md (lines 5-18) and root README.md (lines 14-24) with the new workflow name, install command, and trigger.
4. Compile using make compile as described in gh-agent-workflows/DEVELOPING.md (lines 129-144) to sync .github/workflows/ and generate test-improvement.lock.yml; commit shim copy + lock file.
5. Sanity-check the compiled workflow for correct imports/tools and confirm the prompt avoids .github/workflows edits (per safe-output-create-pr.md lines 1-15).

Related Items

Type	Link	Relevance
Issue	#76	Request for test-improvement agent
File	gh-agent-workflows/small-problem-fixer.md	Schedule/permissions pattern
File	gh-agent-workflows/gh-aw-workflows/small-problem-fixer-rwxp.md	PR-creating prompt pattern
File	gh-agent-workflows/DEVELOPING.md	Workflow creation/compile steps
File	gh-agent-workflows/README.md	Workflow list to update
File	README.md	Top-level workflow list to update
File	gh-agent-workflows/gh-aw-fragments/safe-output-create-pr.md	PR creation constraints

---

What is this? | From workflow: Issue Triage

Give us feedback! React with 🚀 if perfect, 👍 if helpful, 👎 if not. for issue #76

[strawgate]

/ai make a pr for gh-aw only

[github-actions]

PR created: Add test improvement gh-aw workflow.

Summary:

• added a test-improvement shim + prompt focused on targeted test additions and redundant test cleanup
• updated the gh-agent workflows and root README tables

Testing:

• make lint

Compile note:

• make compile failed here because gh-aw v0.45.0 requires Go >= 1.25 and the toolchain download from golang.org/toolchain is blocked in this environment. Please run make compile locally to generate the .lock.yml output.

---

What is this? | From workflow: Mention In Issue

Give us feedback! React with 🚀 if perfect, 👍 if helpful, 👎 if not. for issue #76

Warning

⚠️ Firewall blocked 3 domains

The following domains were blocked by the firewall during workflow execution:

• golang.org
• proxy.golang.org
• telemetry.business.githubcopilot.com