Skip to content

[aw-failures] Conclusion job's setup_globals.cjs MODULE_NOT_FOUND cascade has regressed (repeat of #28149) #49023

Description

@github-actions

Problem

Give the conclusion job's checkout a retry, or bundle its helper scripts — this exact cascade was already root-caused and closed as fixed in April, and it just came back. §30483968883 (PR Sous Chef, 19:20 UTC): the agent, safe_outputs, evals, and every other job in the run succeeded — only the conclusion job failed, at its "Checkout actions folder" step, then cascaded into "Handle agent failure":

##[error]fatal: unable to access 'https://github.com/github/gh-aw/': Could not resolve host: github.com
##[error]fatal: could not fetch e3af0082a628e90622317952eb61abf961f575e0 from promisor remote
##[error]The process '/usr/bin/git' failed with exit code 128
...
Error: Cannot find module '/home/runner/work/_temp/gh-aw/actions/generate_usage_activity_summary.cjs'
...
Error: Cannot find module '/home/runner/work/_temp/gh-aw/actions/setup_globals.cjs'
##[error]Unhandled error: Error: Cannot find module '/home/runner/work/_temp/gh-aw/actions/setup_globals.cjs'

This is the identical two-stage cascade described and closed in #28149 (2026-04-23): a transient DNS/network failure during the conclusion job's fresh git checkout for AWF action helpers turns into a hard MODULE_NOT_FOUND, because handle_agent_failure.cjs (and here, also generate_usage_activity_summary.cjs) import setup_globals.cjs from that same checkout with no fallback. #28149's own remediation options (retry-with-backoff on the checkout, or pre-bundling the helper scripts into the harness) were apparently never applied to this checkout step, or the regression reintroduced an unguarded checkout path.

Affected Workflows and Runs

  • .github/workflows/pr-sous-chef.lock.ymlconclusion job, "Checkout actions folder" / "Handle agent failure" steps
  • §30483968883 (2026-07-29 19:20 UTC) — DNS resolution failure (Could not resolve host: github.com) during checkout, cascading to 2 separate MODULE_NOT_FOUND errors
  • Prior identical pattern (closed as fixed): #28149, 8 runs across 4 workflows on 2026-04-23

Note: the agent and safe_outputs jobs of this same run succeeded fully (see closed #48899 — the previously-tracked AWI_MAINTENANCE_TOKEN 401 issue is unrelated and confirmed fixed by this same run). Only the conclusion/reporting path is affected.

Probable Root Cause

Same as #28149: the conclusion job performs a live git checkout to pull in helper scripts (setup_globals.cjs, generate_usage_activity_summary.cjs, handle_agent_failure.cjs) instead of using pre-bundled harness artifacts. A transient GitHub network blip (DNS/HTTP 5xx) during that checkout is fatal with no retry, and the missing checkout cascades into unrelated-looking MODULE_NOT_FOUND errors that obscure the real root cause for anyone reading only the tail of the log.

Proposed Remediation

Reuse the remediation already scoped in #28149 (apparently not fully/durably applied):

  1. Preferred: Add retry-with-backoff (e.g. 3 attempts, 5s/15s/30s) around the conclusion job's "Checkout actions folder" step.
  2. Alternative: Pre-bundle setup_globals.cjs and other conclusion-job helper scripts into the AWF harness artifacts so the conclusion job never depends on a live checkout.
  3. Regardless of which fix path is taken, add a regression test/check so this doesn't silently regress a third time — e.g. an integration test that simulates checkout failure and asserts the conclusion job still reports gracefully instead of throwing MODULE_NOT_FOUND.

Success Criteria

  • A transient DNS/HTTP 5xx failure during the conclusion job's checkout no longer produces an unhandled MODULE_NOT_FOUND crash.
  • The conclusion job either succeeds after retrying the checkout, or fails with a clear, direct error message about the checkout failure (not a cascaded missing-module error).
  • No recurrence of this exact signature in the following 6h window.

Parent: #48897
Related: #28149 (closed, same root cause), #48899 (closed, unrelated credential issue in the same run)
Related to #48897

Generated by 🔍 [aw] Failure Investigator (6h) · age00 · 161.9 AIC · ⌖ 20.7 AIC · ⊞ 5.2K ·

  • expires on Aug 5, 2026, 5:25 PM UTC-08:00

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions