Smoke Test: Claude Engine Validation
Overall status: PARTIAL (one tool unavailable, one test skipped)
Run: https://github.com/github/gh-aw/actions/runs/26672230109 #35802 (branch copilot/fix-nodejs-access-in-chroot)
Core Tests
#
Test
Result
1
GitHub MCP — last 2 merged PRs (#35826 , #35820 )
✅
2
mcpscripts-gh CLI
⚠️ tool mcpscripts-gh unavailable; used github_pr_query alternative ✅
3
Serena activate + find_symbol (Compiler structs found)
✅
4
make build
✅
5
Playwright navigate (title contains "GitHub")
✅
6
Tavily web search
✅
7
File writing
✅
8
Bash cat verify
✅
9
Discussion query (#35827 )
✅
10
Agentic-workflows status (smoke-claude active)
✅
11
post_slack_message
✅
12
create_code_scanning_alert
✅
13
create_check_run
✅
PR Review Tests
#
Test
Result
14
update_pull_request (append body)
✅
15
create_pull_request_review_comment x2
✅
16
submit_pull_request_review
✅
17
resolve_pull_request_review_thread
✅
18
add_reviewer (copilot)
✅
19
push_to_pull_request_branch
✅
20
close_pull_request
⚠️ skipped (no safe test PR)
Notes
Test 2: the mcpscripts-gh tool is not registered; available mcpscripts tools are github_pr_query, github_issue_query, github_discussion_query, go, make. Reported via missing_tool.
Playwright CLI uses open/goto/eval commands (not browser_navigate/browser_snapshot).
Firewall blocked 6 domains
The following domains were blocked by the firewall during workflow execution:
accounts.google.comandroid.clients.google.comclients2.google.comcontentautofill.googleapis.comsafebrowsingohttpgateway.googleapis.comwww.google.com
To allow these domains, add them to the network.allowed list in your workflow frontmatter:
network :
allowed :
- defaults
- " accounts.google.com" " android.clients.google.com" " clients2.google.com" " contentautofill.googleapis.com" " safebrowsingohttpgateway.googleapis.com" " www.google.com" See Network Configuration for more information.
💥 [THE END] — Illustrated by Smoke Claude · opus48 1.1M · ◷
Smoke Test: Claude Engine Validation
Overall status: PARTIAL (one tool unavailable, one test skipped)
Run: https://github.com/github/gh-aw/actions/runs/26672230109
Timestamp: 2026-05-30 02:45 UTC
PR used for review tests: #35802 (branch
copilot/fix-nodejs-access-in-chroot)Core Tests
mcpscripts-ghunavailable; usedgithub_pr_queryalternative ✅PR Review Tests
Notes
mcpscripts-ghtool is not registered; available mcpscripts tools aregithub_pr_query,github_issue_query,github_discussion_query,go,make. Reported via missing_tool.open/goto/evalcommands (notbrowser_navigate/browser_snapshot).Warning
Firewall blocked 6 domains
The following domains were blocked by the firewall during workflow execution:
accounts.google.comandroid.clients.google.comclients2.google.comcontentautofill.googleapis.comsafebrowsingohttpgateway.googleapis.comwww.google.comSee Network Configuration for more information.