Skip to content

qa run --evidence record schema is undiscoverable: bare invalid_request and no schema docs #375

Closed

Description

@barbatdev

Split from #368 (item 3 of 3, per the fleet review recommending a per-subsystem split). Same secondary finding as #308.

Problem

The --evidence record schema accepted by cortex qa run is undiscoverable. A JSON file with a custom top-level shape ({"schema": ..., "candidate": ..., "evidence": [...]}) produces bare invalid_request, and cortex qa run --help documents neither the accepted record schema nor a pointer to where it lives.

Expected outcome

  • --evidence validation failures report which field failed and why, not bare invalid_request.
  • The evidence record schema is documented in qa run help or a referenced doc.

Affected scope

Evidence admission validation and its documentation only. Stage-attributed refusals for qa run are tracked in #374.

Refs #368, #308.

Activity

  1. ayushkrsingh946 commented on Oct 23, 2026

    @ayushkrsingh946
    Contributor

    Addressed in #376 with field/reason diagnostic attribution on evidence validation failures and full schema documentation in qa run --help and docs/operating.md.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions