Skip to content

[Fleet Monitor] petry-projects/google-app-scripts — ci-failure-analyst.yml #322

Closed
Closed
[Fleet Monitor] petry-projects/google-app-scripts — ci-failure-analyst.yml#322
Labels
dev-leadFor dev-lead agent pickupfleet-trackerhealth-check

Description

@don-petry
don-petry
opened on May 25, 2026

🟡 WARNING: petry-projects/google-app-scripts / ci-failure-analyst.yml

Metric Value
Failure Rate 12.5% (5 / 40 runs)
Status WARNING
p50 Duration 2s
p95 Duration 724s
Successful Runs 0
Cancelled Runs 7

Workflow: ci-failure-analyst.yml

Last updated by Fleet Monitor run on 2026-05-27.
Threshold: failure rate > 10% over the monitored window.

Activity

  1. don-petry
    added
    health-check
    dev-leadFor dev-lead agent pickup
    fleet-tracker
    on May 25, 2026

  2. don-petry commented on May 25, 2026

    @don-petry
    don-petry
    on May 25, 2026
    CollaboratorAuthor

    Dev-Lead Implementation Plan

    Issue: #322 — [Fleet Monitor] petry-projects/google-app-scripts — ci-failure-analyst.yml

    Scope

    Bump the pinned ci-failure-analyst-reusable.yml SHA in .github/workflows/ci-failure-analyst.yml from 121bee88 to the current petry-projects/.github-private main SHA 6610e8a0 so the workflow picks up commit db60a41e (ci: Add fallback-model opus to CI Failure Analyst) and 6610e8a0 (feat(engine): in-Claude model fallback before cross-provider switch), which resolve the Sonnet-rate-limit failures (You've hit your Sonnet limit · resets May 26, 4pm (UTC)) seen on both recent failed runs (26356873327 and 26372547948).

    Implementation Checklist

    • Update pinned reusable workflow SHA in .github/workflows/ci-failure-analyst.yml:44
    • Run npx prettier --write . to ensure formatting
    • Run npm run check (prettier check + lint)
    • Run npm test (Jest + coverage)

    Tests to Write

    None. This is a workflow-only configuration change — bumping a pinned commit SHA in a stub workflow that delegates all logic to a reusable workflow in another repository. No application code changes. Per AGENTS.md, this qualifies as the "pure configuration / behavior-preserving" TDD exception (Phase 2). Existing Jest suite and npm run check still gate the change.

    Test Command

    npm test (and npm run check)

  3. don-petry commented on May 25, 2026

    @don-petry
    don-petry
    on May 25, 2026
    CollaboratorAuthor

    Dev-Lead: Implementation Complete

    Plan Execution

    • Investigated both failed runs (26356873327, 26372547948) — root cause was You've hit your Sonnet limit · resets May 26, 4pm (UTC) in the claude --print step of the reusable workflow.
    • Confirmed petry-projects/.github-private main now contains db60a41e (ci: Add fallback-model opus to CI Failure Analyst) and 6610e8a0 (feat(engine): in-Claude model fallback before cross-provider switch), which directly address this failure mode.
    • Bumped pinned reusable workflow SHA in .github/workflows/ci-failure-analyst.yml:44 from 121bee88 → 6610e8a0.
    • Applied npx prettier --write (also normalized pre-existing quote/whitespace drift in the same file so npm run check passes).
    • Ran npm run check, npm test, npm test -- --coverage, and node scripts/check-coverage.js.

    Test Results

    > google-app-scripts@0.0.0 test
> jest --runInBand

Test Suites: 12 passed, 12 total
Tests:       301 passed, 301 total
Snapshots:   0 total
Time:        4.142 s

📊 Coverage Report:
✅ statements     : 98.91% (999/1010) [required: 95%]
✅ branches       : 90.00% (558/620) [required: 85%]
✅ functions      : 98.00% (98/100) [required: 95%]
✅ lines          : 100% (0/0) [required: 100%]
✅ All coverage metrics meet requirements.

npm run check → 0 errors (22 pre-existing unused-var warnings, unchanged)

    Files Changed

    • .github/workflows/ci-failure-analyst.yml: bumped pinned reusable-workflow SHA from 121bee881bd13715706d30230b2d5a8d2d78b0b1 to 6610e8a03fc4d568946f45a02ea23bf3e858de3f; prettier-normalized incidental quote/whitespace drift in the same file.

    Notes

    • TDD exception applied: Per AGENTS.md, no tests were written — this is a pure workflow-config (pinned-SHA) change with no observable behavior change in this repo's code. All logic lives in the reusable workflow in petry-projects/.github-private.
    • Root cause is rate-limit / external usage cap, not a defect in this repo's stub. The fix relies on the upstream reusable workflow's new --fallback-model opus flag (db60a41e) plus the engine-level in-Claude fallback (6610e8a0) to keep the analyst functional when the primary Sonnet quota is exhausted.
    • Follow-up suggestion (not in scope here): the templates/ci-failure-analyst.yml in petry-projects/.github-private still pins the old 121bee88 SHA. Other repos that deploy the template will hit the same issue until the template is bumped too.
  4. don-petry
    added
    dev-leadFor dev-lead agent pickup
    and removed
    dev-leadFor dev-lead agent pickup
    on Jun 3, 2026

  5. don-petry commented on Jun 8, 2026

    @don-petry
    don-petry
    on Jun 8, 2026
    CollaboratorAuthor

    Dev-Lead Implementation Plan

    Issue: #322 — [Fleet Monitor] petry-projects/google-app-scripts — ci-failure-analyst.yml

    Scope

    Bump the pinned ci-failure-analyst-reusable.yml SHA in .github/workflows/ci-failure-analyst.yml from 121bee881bd13715706d30230b2d5a8d2d78b0b1 (old) to 93f03dbc88b5aa053efc09954c4d7bec75a7ead9 (current petry-projects/.github-private main HEAD) to pick up all upstream fixes including the Sonnet rate-limit fallback (db60a41e, 6610e8a0) and subsequent improvements.

    Implementation Checklist

    • Update pinned reusable workflow SHA in .github/workflows/ci-failure-analyst.yml line 44
    • Run npx prettier --write . to ensure formatting
    • Run npm run check (prettier check + lint)
    • Run npm test (Jest + coverage)

    Tests to Write

    None — this is a pure workflow-configuration (pinned-SHA) change with no observable behavioral change in this repo's application code. All logic lives in the reusable workflow in petry-projects/.github-private. Per AGENTS.md, this qualifies for the TDD exception.

    Test Command

    npm test (and npm run check)

  6. don-petry commented on Jun 8, 2026

    @don-petry
    don-petry
    on Jun 8, 2026
    CollaboratorAuthor

    Dev-Lead: Implementation Complete

    Plan Execution

    • Investigated issue — root cause was You've hit your Sonnet limit in the reusable workflow; upstream fixes exist in petry-projects/.github-private main since 6610e8a0 (ci: Add fallback-model opus) and beyond
    • Fetched current petry-projects/.github-private main HEAD SHA: 93f03dbc88b5aa053efc09954c4d7bec75a7ead9
    • Bumped pinned reusable workflow SHA in .github/workflows/ci-failure-analyst.yml from 121bee881bd13715706d30230b2d5a8d2d78b0b1 → 93f03dbc88b5aa053efc09954c4d7bec75a7ead9
    • Fixed pre-existing ShellCheck SC2043 warnings in scripts/apply-repo-settings.sh and scripts/setup-code-quality-ruleset.sh (required by dev-lead-lint.sh)
    • Ran npm run check, npm test, npm test -- --coverage, node scripts/check-coverage.js, bash .dev-lead/scripts/dev-lead-lint.sh

    Test Results

    Test Suites: 12 passed, 12 total
Tests:       301 passed, 301 total
Snapshots:   0 total
Time:        1.841 s

📊 Coverage Report:
✅ statements     : 98.91% (999/1010) [required: 95%]
✅ branches       : 90.00% (558/620) [required: 85%]
✅ functions      : 98.00% (98/100) [required: 95%]
✅ lines          : 100% (0/0) [required: 100%]
✅ All coverage metrics meet requirements.

npm run check → 0 errors (22 pre-existing unused-var warnings, unchanged)
dev-lead-lint.sh → all checks passed

    Files Changed

    • .github/workflows/ci-failure-analyst.yml: bumped pinned reusable-workflow SHA from 121bee88... to 93f03dbc... (current .github-private main HEAD), picking up all upstream fixes including the Sonnet rate-limit fallback and subsequent improvements
    • scripts/apply-repo-settings.sh: replaced single-item for cmd in gh loop with direct command -v gh check (fixes ShellCheck SC2043 warning)
    • scripts/setup-code-quality-ruleset.sh: same SC2043 fix as above

    Notes

    • TDD exception applied: Pure workflow-config + lint-fix change; no observable behavioral change in this repo's application code.
    • SHA bumped to HEAD (not just 6610e8a0 as in the prior attempt): the current HEAD 93f03dbc includes the Sonnet fallback plus all subsequent improvements merged through 2026-06-08.
    • Prior agent's PR was never merged — the previous attempt posted a completion report but the branch was abandoned without opening a PR. This run implements the fix fresh on dev-lead/issue-322-20260608-2017.
  7. don-petry
    added
    dev-leadFor dev-lead agent pickup
    and removed
    dev-leadFor dev-lead agent pickup
    on Jun 9, 2026

  8. don-petry commented on Jun 9, 2026

    @don-petry
    don-petry
    on Jun 9, 2026
    CollaboratorAuthor

    Dev-Lead Implementation Plan

    Issue: #322 — [Fleet Monitor] petry-projects/google-app-scripts — ci-failure-analyst.yml

    Scope

    Bump the pinned ci-failure-analyst-reusable.yml SHA in .github/workflows/ci-failure-analyst.yml from 121bee881bd13715706d30230b2d5a8d2d78b0b1 (original) to 819d1a24bd717669416355e5ba6fadd1418b730c (current petry-projects/.github-private main HEAD as of 2026-06-09) to pick up the Sonnet rate-limit fallback fixes (db60a41e, 6610e8a0) and all subsequent improvements. Previous attempts identified the root cause as You've hit your Sonnet limit in the reusable workflow; this bumps to HEAD to capture all upstream fixes. Also fixes pre-existing ShellCheck SC2043 warnings in scripts/ found by dev-lead-lint.sh.

    Implementation Checklist

    • Update pinned reusable workflow SHA in .github/workflows/ci-failure-analyst.yml (line 44)
    • Fix ShellCheck SC2043 warnings in scripts/apply-repo-settings.sh and scripts/setup-code-quality-ruleset.sh
    • Run npx prettier --write . to ensure formatting
    • Run npm run check (prettier check + lint)
    • Run npm test (Jest + coverage)
    • Run bash .dev-lead/scripts/dev-lead-lint.sh

    Tests to Write

    None — this is a pure workflow-configuration (pinned-SHA) change with no observable behavioral change in this repo's application code. All logic lives in the reusable workflow in petry-projects/.github-private. Per AGENTS.md, this qualifies for the TDD exception (pure configuration change).

    Test Command

    npm test (and npm run check)

  9. don-petry commented on Jun 9, 2026

    @don-petry
    don-petry
    on Jun 9, 2026
    CollaboratorAuthor

    Dev-Lead: Implementation Complete

    Plan Execution

    • Investigated root cause — both original failures (and two recent ones on 2026-06-01) were You've hit your Sonnet limit in the claude --print step of the reusable workflow
    • Fetched current petry-projects/.github-private main HEAD SHA: 819d1a24bd717669416355e5ba6fadd1418b730c (2026-06-09)
    • Bumped pinned reusable workflow SHA in .github/workflows/ci-failure-analyst.yml from 121bee881bd13715706d30230b2d5a8d2d78b0b1 → 819d1a24bd717669416355e5ba6fadd1418b730c
    • Fixed pre-existing ShellCheck SC2043 warnings in scripts/apply-repo-settings.sh and scripts/setup-code-quality-ruleset.sh (flagged by dev-lead-lint.sh)
    • Ran npx prettier --write ., npm run check, npm test, npm test -- --coverage, node scripts/check-coverage.js, bash .dev-lead/scripts/dev-lead-lint.sh

    Test Results

    Test Suites: 12 passed, 12 total
Tests:       301 passed, 301 total
Snapshots:   0 total
Time:        4.324 s

📊 Coverage Report:
✅ statements     : 98.91% (999/1010) [required: 95%]
✅ branches       : 90.00% (558/620) [required: 85%]
✅ functions      : 98.00% (98/100) [required: 95%]
✅ lines          : 100% (0/0) [required: 100%]
✅ All coverage metrics meet requirements.

npm run check → 0 errors (22 pre-existing unused-var warnings, unchanged)
dev-lead-lint.sh → all checks passed

    Files Changed

    • .github/workflows/ci-failure-analyst.yml: bumped pinned reusable-workflow SHA from 121bee88... to 819d1a24... (current .github-private main HEAD as of 2026-06-09), picking up the Sonnet rate-limit fallback (db60a41e, 6610e8a0) and all subsequent improvements
    • scripts/apply-repo-settings.sh: replaced for cmd in gh; do single-item loop with direct command -v gh check (fixes ShellCheck SC2043)
    • scripts/setup-code-quality-ruleset.sh: same SC2043 fix

    Notes

    • TDD exception applied: Pure workflow-config + lint-fix change; no observable behavioral change in this repo's application code. All analysis logic lives in the reusable workflow in petry-projects/.github-private.
    • Root cause: Sonnet session-rate-limit exhaustion — not a defect in the stub workflow. The upstream db60a41e + 6610e8a0 commits added --fallback-model opus to keep the analyst functional when the primary Sonnet quota is exhausted.
    • SHA bumped to current HEAD (819d1a24) rather than just the initial fix commit (6610e8a0) to capture all improvements merged through 2026-06-09.
    • Prior attempts: Two previous agents implemented this fix (bumping to 6610e8a0 then 93f03dbc) but neither opened a PR; this run re-implements on the current branch dev-lead/issue-322-20260609-2206.

  10. don-petry commented on Jul 15, 2026

    @don-petry
    don-petry
    on Jul 15, 2026
    CollaboratorAuthor

    ✅ Auto-resolved by Fleet Monitor. This workflow's failure rate has been below the 10% threshold (or the workflow was removed) since 2026-05-27 (49 days) — the monitor stopped flagging it. Closing. It will reopen automatically if the workflow crosses the threshold again.

  11. don-petry
    closed this as completedon Jul 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    dev-leadFor dev-lead agent pickupfleet-trackerhealth-check

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions