Skip to content

[aw-failures] Fix: config.models is not supported — unsupported AWF config field blocks entire smoke sweep (10 runs) #30307

@github-actions

Description

@github-actions

Problem Statement

PR branch copilot/add-models-section-to-awf-config added a top-level models key to awf-config.json introducing 7 model aliases. The AWF firewall (v0.25.38) performs strict schema validation at agent startup and hard-fails with:

Error loading --config: Invalid AWF config at /home/runner/work/_temp/gh-aw/awf-config.json:
- config.models is not supported

This prevents the agent from starting entirely — 0 turns, 0 tokens, $0 cost per affected run. The failure cascades to every workflow triggered by the PR.

Affected Workflows and Run IDs

Run Workflow Engine
§25362446948 Smoke Claude Claude Code
§25362446886 Smoke Codex Codex
§25362446852 Smoke Gemini Google Gemini CLI
§25362446868 Smoke Pi Pi
§25362446872 Smoke Copilot GitHub Copilot CLI
§25362446848 Agent Container Smoke Test GitHub Copilot CLI
§25362446861 Changeset Generator Codex
§25362595021 Design Decision Gate Claude Code
§25362595018 Test Quality Sentinel GitHub Copilot CLI
§25362595617 Matt Pocock Skills Reviewer GitHub Copilot CLI

All 10 runs failed at the same startup validation step. Individual failure tracking: #30241, #30244, #30242, #30231, #30300, #30299, #30298, #30296, #30272.

Probable Root Cause

The AWF config schema (v0.25.38) does not include a models field. The PR added this field to support model aliasing, but the firewall schema validation rejects unknown top-level keys. The PR was likely created ahead of schema support being shipped.

Proposed Remediation

Option A (immediate): Revert or remove the models field from awf-config.json in the copilot/add-models-section-to-awf-config PR branch until schema support is added to AWF.

Option B (preferred long-term): Add config.models support to the AWF firewall schema validation before or alongside the PR merge. This should be the approach if the models aliasing feature is ready to ship.

Success Criteria

Parent report: see linked parent issue.

Generated by [aw] Failure Investigator (6h) · ● 950.6K ·

  • expires on May 12, 2026, 7:49 AM UTC


Closing as fixed (2026-05-09 failure investigation)

This issue is now fixed. The AWF schema has been updated so the models aliases are now correctly placed under apiProxy.models (no longer rejected as a top-level config.models).

Evidence: awf-config.json from a recent run on firewall v0.25.42 shows models correctly nested under apiProxy.models:

{
  "apiProxy": {
    "enabled": true,
    "models": {
      "auto": ["large"],
      "sonnet": ["copilot/*sonnet*", "anthropic/*sonnet*"],
      ...
    }
  }
}

No config.models is not supported error appears in any agent-stdio log from the past 6h window. Recent runs that consume the schema (e.g. §25605079586 Smoke Gemini on PR #31224) load awf-config.json cleanly — the agent starts and progresses past schema validation.

Reopen if any future run shows Error loading --config: ... config.models is not supported.

Generated by [aw] Failure Investigator (6h) · ● 24.7M ·

Metadata

Metadata

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions