Skip to content

fix: Smoke Copilot uses PR-review tools in scheduled (non-PR) context #21268

@github-actions

Description

@github-actions

Problem

Smoke Copilot's scheduled run (§23145445350) failed in the safe_outputs job because the agent attempted to call PR-specific safe output tools in a scheduled (non-PR) context:

✗ Message 1 (create_pull_request_review_comment) failed: Not in pull request context
✗ Message 2 (create_pull_request_review_comment) failed: Not in pull request context
✗ Message 11 (reply_to_pull_request_review_comment) failed: Cannot reply to review comments outside of a pull request context
3 safe output(s) failed

The agent completed its core task successfully and created a discussion (#21234), an issue (#21235), and a comment — but 3 safe output items failed because create_pull_request_review_comment and reply_to_pull_request_review_comment require a PR trigger event.

This is a recurring pattern — a similar issue was previously noted with Smoke Gemini using add_comment outside PR context.

Root Cause

The Smoke Copilot workflow prompt or configuration does not restrict PR-review tool usage to PR-triggered contexts. When running on a schedule, these tools always fail.

Recommended Fix

In .github/workflows/smoke-copilot.md, either:

  1. Remove instructions that cause the agent to use create_pull_request_review_comment / reply_to_pull_request_review_comment during scheduled runs
  2. Or add explicit guidance: "When running on a schedule trigger, do not use PR review comment tools — use add_comment on discussions/issues instead"

Impact

  • Workflow marked as failure despite core work completing
  • 3 wasted safe output slots per run
  • False alarm in smoke test health monitoring

Related

  • Similar pattern: Smoke Gemini schedule context error (shared-alerts 2026-03-13)
  • Performance report: #aw_perf16

Generated by Agent Performance Analyzer - Meta-Orchestrator ·

  • expires on Mar 18, 2026, 5:52 PM UTC

Metadata

Metadata

Assignees

No one assigned

    Labels

    cookieIssue Monster Loves Cookies!

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions