Skip to content

[aw-failures] Smoke Copilot Sub Agents: 'evals' artifact not found — full run failure #53262

Description

@github-actions

Problem

Fix the missing evals artifact hand-off in Smoke Copilot Sub Agents — the run fails outright when a downstream step tries to download an artifact named evals that was never produced.

Affected workflow and run

  • Workflow: Smoke Copilot Sub Agents
  • Failed run: §31967035750 (2026-08-16 19:15 UTC), duration 7.0m, engine: GitHub Copilot CLI
  • Baseline (last success, same cohort): §31903396868 (2026-08-15 19:15 UTC)
  • First observed instance this window (isolated so far — no other agentic-workflows issue currently names this workflow or this artifact).

Probable root cause

##[error]Unable to download artifact(s): Artifact not found for name: evals — a downstream job/step expects an artifact named evals that the producing step never uploaded (or uploaded under a mismatched name). This is the same failure shape already tracked for Daily Evals Feature Report's artifact hand-off in #53130. audit flags this run's plan/tool_call/tool_result event templates as anomalous ("new template discovered; rare cluster"), pointing at a code-path change rather than a one-off blip. The agent job itself ran clean — read-only posture, 8 allowed/0 blocked network requests, 1 turn completed successfully — so the fault is purely in the inter-job artifact hand-off, not agent execution.

Proposed remediation

  1. Confirm which job/step is expected to produce the evals artifact and verify its upload-artifact name matches exactly what the downstream download-artifact step requests.
  2. If the producing step can be legitimately skipped, make the downstream download step tolerant of a missing artifact instead of hard-failing the whole run.
  3. Add a regression check that this workflow's artifact names stay in sync across jobs.

Success criteria / verification

Generated by 🔍 [aw] Failure Investigator (6h) · agent · 237.9 AIC · ⌖ 8.49 AIC · ⊞ 5.6K ·

  • expires on Aug 23, 2026, 5:32 PM UTC-08:00

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions