Smoke Test Results: Claude Engine — Run 32807401168
Run URL: https://github.com/github/gh-aw/actions/runs/32807401168
Timestamp: 2026-08-25T04:07 UTC
PR Used for Review Testing: #55587 (Write MCP CLI wrapper scripts with owner-only permissions)
Overall Status: 🟡 PARTIAL (17 passed, 2 skipped)
Core Tests (#1 –12)
#
Test
Result
Notes
1
GitHub MCP Testing
✅
PRs #55588 , #55580 retrieved
2
GH CLI Testing
✅
gh pr list returned 2 merged PRs
3
Make Build Testing
✅
go build succeeded, binary produced
4
Playwright Testing
✅
Page title: "GitHub · Change is constant..."
5
Tavily Web Search Testing
✅
5 results for "GitHub Agentic Workflows"
6
File Writing Testing
✅
/tmp/gh-aw/agent/smoke-test-claude-32807401168.txt created
7
Bash Tool Testing
✅
File contents verified via cat
8
Discussion Interaction Testing
✅
Discussion #335 extracted; comment added
9
Agentic Workflows MCP Testing
✅
smoke-claude status: active , compiled: Yes
10
Slack Script Safe Output Testing
✅
Message posted to #smoke-tests
11
Code Scanning Alert Safe Output Testing
✅
Dummy warning alert created
12
Check Run Safe Output Testing
✅
Check run created with conclusion: success
PR Review Tests (#13 –19)
#
Test
Result
Notes
13
Update PR Testing
✅
PR body appended with test message
14
PR Review Comment Testing
✅
2 review comments added on different files
15
Submit PR Review Testing
✅
Review submitted (COMMENT event)
16
Resolve Review Thread Testing
⚠️
Skipped — GraphQL API returned null data (permissions)
17
Add Reviewer Testing
✅
copilot reviewer added
18
Push to PR Branch Testing
✅
smoke-test-files/smoke-claude-push-test.md pushed
19
Close PR Testing
⚠️
Skipped — no safe test PR to close
Agentic Workflows Status Detail (Test #9 )
smoke-claude : engine=claude, compiled=Yes, status=active
smoke-claude-on-copilot : engine=claude, compiled=Yes, status=Unknown
Dependencies: shared/gh.md, shared/github-mcp-app.md, shared/go-make.md, shared/mcp/tavily.md, shared/otlp.md, shared/reporting.md, shared/smoke-test-brevity.md, shared/token-telemetry-check.md
Notes
Warning
Firewall blocked 2 domains
The following domains were blocked by the firewall during workflow execution:
clients2.google.com
mtalk.google.com
To allow these domains, add them to the network.allowed list in your workflow frontmatter:
network :
allowed :
- defaults
- " clients2.google.com"
- " mtalk.google.com"
See Network Configuration for more information.
💥 [THE END] — Illustrated by Smoke Claude · claude · sonnet46 · 89.2 AIC · ⌖ 18.8 AIC · ⊞ 7.1K · ◷
Comment /smoke-claude to run again
Smoke Test Results: Claude Engine — Run 32807401168
Run URL: https://github.com/github/gh-aw/actions/runs/32807401168
Timestamp: 2026-08-25T04:07 UTC
PR Used for Review Testing: #55587 (Write MCP CLI wrapper scripts with owner-only permissions)
Overall Status: 🟡 PARTIAL (17 passed, 2 skipped)
Core Tests (#1–12)
gh pr listreturned 2 merged PRsgo buildsucceeded, binary produced/tmp/gh-aw/agent/smoke-test-claude-32807401168.txtcreatedcatsmoke-claudestatus: active, compiled: YesPR Review Tests (#13–19)
copilotreviewer addedsmoke-test-files/smoke-claude-push-test.mdpushedAgentic Workflows Status Detail (Test #9)
shared/gh.md,shared/github-mcp-app.md,shared/go-make.md,shared/mcp/tavily.md,shared/otlp.md,shared/reporting.md,shared/smoke-test-brevity.md,shared/token-telemetry-check.mdNotes
{"data":null}) — review thread resolution skippedplaywright-clirequiredinstall --skillsbefore use; works after installsmoke-claudelabel already present on PR Write MCP CLI wrapper scripts with owner-only permissions (0o700) instead of 0o755 #55587 from previous runWarning
Firewall blocked 2 domains
The following domains were blocked by the firewall during workflow execution:
clients2.google.commtalk.google.comTo allow these domains, add them to the
network.allowedlist in your workflow frontmatter:See Network Configuration for more information.