Skip to content

Tracking: CI improvements #18036

Description

@radical

[automated] Canonical tracker for current CI improvement work in microsoft/aspire. Each outcome links to its tracking issue when one exists, with the implementing pull request and next concrete action alongside it. Completed work is collected at the bottom.

Status: 🚧 In progress (draft work) · 👀 Ready for review · ⛔ Blocked · ⏳ To do · ✅ Done

Selective and faster PR CI

Status Work / tracking issue Implementation PR Next step
☐ 🚧 In progress Run a weekly audit for test-selection drift (inline) #20324 Address the latest review feedback, finish CI, then request review.
☐ 🚧 In progress Complete the bounded selective-CI accuracy audit — Publish the final classification and transition ongoing monitoring to #20324.
☐ ⏳ To do Land renamed-path parsing and selector diagnostics fixes #19790 (draft) Decide whether to refresh and resume or close the inactive draft.
☐ ⏳ To do Add focused Copilot review guidance for trigger-map changes (inline) #19942 (draft) Decide whether to refresh and resume or close the inactive draft.
☐ ⏳ To do Measure the before/after PR CI improvement (inline) — Reconstruct comparable pre-enforcement runs and compare representative post-enforcement runs after the audit workflow lands.

During rollout, favor safety over savings: use full CI whenever routing is uncertain, and record both missed required coverage and unnecessary selections.

Automated CI issue quality and monitoring

Status Work / tracking issue Implementation PR Next step
☐ 👀 Ready for review Publish multiple tests affected by one flaky cause to a single issue #20333 Review and merge.
☐ 👀 Ready for review Automatically rerun failed current-main rolling builds #20345 Review and merge.
☐ 🚧 In progress Reconcile duplicate automated failure issues across races and replays (inline) #19805 (draft) Finish implementation and validation, then request review.

CI reliability

Status Work / tracking issue Implementation PR Next step
☐ 👀 Ready for review Fix Radius MongoDB outerloop test selection (inline) #20411 Review and merge.
☐ 🚧 In progress Treat the Deployment E2E zero-tests result correctly #20308 (draft) Finish implementation and review.
☐ 🚧 In progress Fix the RemoteHost test restore warning in CI #20305 (draft) Finish implementation and review.
☐ 🚧 In progress Fix the current template-test CI failure (inline) — Finish the active investigation and open or link the implementation PR.

Older quality-gate drafts needing a decision

Status Work / tracking issue Implementation PR Next step
☐ ⏳ To do Validate published Aspire CLI builds end-to-end from Azure DevOps and GitHub (inline) #17532 (draft) Decide whether to resolve the stale failures and resume or close the draft.
☐ ⏳ To do Add zizmor GitHub Actions security analysis (inline) #15987 (draft) Decide whether to refresh and resume or close the inactive draft.

Completed

Status Work / tracking issue Implementation PR Completed
☑ ✅ Done Select installer jobs and loose CI dependencies correctly (inline) #19687 2026-08-28
☑ ✅ Done Enable selective test and job execution with a full-CI escape hatch (inline) #19688 2026-08-28
☑ ✅ Done Keep CI green while preserving Azure Functions E2E diagnostics #19760 2026-09-01
☑ ✅ Done Consolidate test execution into selector-friendly lanes #19761 2026-09-02
☑ ✅ Done Gate all six CLI Starter Validation jobs on selector output (inline) #19807 2026-09-03
☑ ✅ Done Fix and automatically validate the Copilot setup workflow #19910 2026-09-04
☑ ✅ Done Run extension and CLI E2E only for actual consumers #19882 2026-09-14
☑ ✅ Done Enforce selector dependency invariants (inline) #19926 2026-09-14
☑ ✅ Done Skip CI for generated API/ATS baseline-only changes (inline) #19939 2026-09-14
☑ ✅ Done Correctly classify main-branch CI failures #19455 2026-09-22
☑ ✅ Done Tighten PR test selection to avoid unnecessary full runs (inline) #20322 2026-09-24

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

area-engineering-systemsinfrastructure helix infra engineering repo stufftrackingTracking issue for some TODOs

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions