Skip to content

ci: temporarily disable flaky progress conformance scenario - #106

Merged
lucarlig merged 2 commits into
mainfrom
user/luca/disable-flaky-progress-conformance
Aug 20, 2026
Merged

ci: temporarily disable flaky progress conformance scenario#106
lucarlig merged 2 commits into
mainfrom
user/luca/disable-flaky-progress-conformance

Conversation

@lucarlig

Copy link
Copy Markdown
Contributor

Summary

  • remove tools-call-with-progress from the expected-failure baseline
  • apply an exact patch to the pinned conformance requirements so the flaky scenario is not run
  • keep the workaround explicit because conformance 0.2.0-alpha.11 has no scenario-exclusion option

Why

Progress notifications and the final response are processed by separate tasks. Depending on scheduling, cleanup can happen before progress forwarding completes, so the scenario can either pass or fail. An expected-failure entry is unsuitable because a passing run becomes an XPASS and fails CI.

This is temporary until progress forwarding and final-response cleanup are ordered deterministically.

Verification

  • tests/conformance/report-baseline-diff-test.sh
  • applied tests/conformance/disable-flaky-progress.patch against pinned conformance SHA c321dd32035556e6769d3724a8ee97d87c3faaac
  • git diff --check
  • signed-commit hooks, including cargo nextest run --locked --workspace

Signed-off-by: lucarlig <luca.carlig@ibm.com>
@lucarlig
lucarlig marked this pull request as ready for review August 20, 2026 09:25
@lucarlig
lucarlig requested a review from cafalchio August 20, 2026 09:25
cafalchio
cafalchio previously approved these changes Aug 20, 2026

@cafalchio cafalchio left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@cafalchio cafalchio left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lucarlig
lucarlig merged commit 6a535dd into main Aug 20, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants