[aviggiano]

Shift audit effort from repeated ordinary strategies into stateful fuzzing. Fresh default projects now include all five invariant stages, and exhaustive spends four hours fuzzing one shared suite of selected properties.

Setting	Default	Exhaustive
Ordinary strategy passes	2	3
Stateful stages	All five, once each	All five, once each
Invariant property priority	High	High and medium
Final Recon fuzzing duration	1 hour	4 hours

Keep explicit project and runtime overrides authoritative. Separate packaged defaults from the repository's editable configuration, and omit profile-managed settings during initialization so switching profiles inherits the correct values. Effective loop reporting follows the selected topology.

Reference expectation tags remain provenance metadata and do not bypass normal priority selection. The benchmark-specific invariant-only profile retains explicit mandatory selection. Prompts, artifact gates, shared coverage validation, and generated final reports use the same resolved policy; excluded expected checks remain visible as unselected, never fulfilled. Existing sealed configurations retain their legacy interpretation.

Exhaustive's campaign task allows 16,200 seconds, with inherited per-node Modal resources providing another 1,800 seconds for lifecycle work. Explicit undersized global or node resource caps fail before submission. The existing 24-hour workflow deadline still bounds all stages and retries. Public full benchmark rows capped at 15,000 seconds reject the four-hour profile before credential access instead of shortening the campaign or silently raising paid budgets; local and per-node Modal execution support the new duration.

Validation passed: full workspace build; 94 configuration, 352 artifact, 73 topology, 104 prompt, 685 Modal, 212 runtime support, and 8 runtime budget/cloud tests; TypeScript, changed-code strict lint, formatting, generated docs, and Knip. Independent source review has no outstanding findings. Packed installation passed for all 12 packages, including fresh init and validation; packaged profile-asset validation and all 102 CI-script tests passed. The six CLI smoke cases and 54 runtime smoke cases passed (one stale run-plan assertion was corrected and rerun separately). No paid inference or cloud workload was launched.

This PR is stacked on #1131 to inherit the CI repairs and patched ZIP dependency. Merge #1131 first, then target this PR at main; its diff contains only the profile revision.

Fixes #1130

Confidence Score: 5/5

The PR appears safe to merge; no outstanding correctness, security, or repository-rule issue was identified.

Summary

This PR shifts the default and exhaustive audit profiles toward stateful invariant fuzzing, adds profile-aware property-selection policy, and introduces validated timeout envelopes for four-hour exhaustive campaigns.

• Adds all five stateful invariant stages to fresh default topologies while reducing ordinary strategy repetition.
• Gives exhaustive audits high/medium property selection and a shared four-hour Recon campaign.
• Separates packaged defaults from editable project configuration and preserves explicit project/runtime overrides.
• Propagates selection policy and timeout provenance through prompts, manifests, artifact gates, reports, local execution, and Modal admission.
• Rejects explicit cloud resource caps that cannot contain the resolved task budget instead of silently shortening work.
• The only change since the previous review aligns a cloud handoff test fixture with its effective 3,600-second low-cost task budget.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart LR
    A[Packaged defaults] --> D[Configuration resolution]
    B[Selected audit profile] --> D
    C[Project and runtime overrides] --> D
    D --> E[Resolved invariant policy]
    E --> F[Property selection]
    E --> G[Prompt rendering]
    E --> H[Artifact validation and reporting]
    D --> I[Resolved task timeout]
    I --> J{Execution mode}
    J --> K[Local execution]
    J --> L[Modal admission]
    L --> M{Explicit resource cap sufficient?}
    M -->|No| N[Reject before submission]
    M -->|Yes| O[Run task with lifecycle reserve]

Loading

_{Reviews (3) · Last reviewed commit: "Align cloud handoff fixture limits with ..."}