Skip to content

Build: Pull MinIO images from Quay (cherry-pick apache/iceberg#18071) - #11

Merged
nickwu241 merged 1 commit into
1.11.0-affirm-patchfrom
nick/cherry-pick-18071-minio-quay
Sep 22, 2026
Merged

nickwu241 merged 1 commit into
1.11.0-affirm-patchfrom
nick/cherry-pick-18071-minio-quay

Conversation

@nickwu241

Copy link
Copy Markdown
Member

Cherry-picks apache#18071 (apache/iceberg@cff60bc18e) onto 1.11.0-affirm-patch.

Why this is needed

MinIO deleted the minio/minio and minio/mc images from Docker Hub on 2026-09-11 (minio/minio and minio/mc now return "repository does not exist"). This fork still references those Docker Hub images in two places:

  • aws/src/integration/java/org/apache/iceberg/aws/s3/MinioUtil.java — used by iceberg-aws's core-tests integration tests (TestFlakyS3InputStream, TestMinioUtil, TestS3FileIO*)
  • kafka-connect/kafka-connect-runtime/docker/docker-compose.yml — used by kafka-connect-tests' TestIntegration* suite via ComposeContainer

Since the deletion, both core-tests and kafka-connect-tests fail deterministically on every PR against this branch (verified via 3 rerun attempts against #10, all producing the identical com.github.dockerjava.api.exception.NotFoundException pulling these images) — this is not flaky/rate-limited CI, the images are permanently gone.

Upstream apache/iceberg hit the same break and fixed it same-day with apache#18071, repointing both files at quay.io/minio/minio / quay.io/minio/mc (MinIO's images remain available there). main has been green since; this fork never picked up that commit because 1.11.0-affirm-patch was cut before it landed.

Commit

Direct cherry-pick of apache/iceberg@cff60bc18e ("Build: Pull MinIO images from Quay", apache#18071), no conflicts, no adaptation needed — same 2 files this fork actually uses (docker/iceberg-flink-quickstart/docker-compose.yml and site/docs/spark-quickstart.md are also in the upstream commit but don't exist / aren't relevant on this branch's build).

Verification

  • Cherry-pick applied cleanly against origin/1.11.0-affirm-patch; diff matches upstream's change exactly.
  • Not yet re-run through this fork's CI — opening for review/merge so core-tests and kafka-connect-tests go green here the same way they already are on upstream main.

🤖 Generated with Claude Code

@nickwu241
nickwu241 merged commit 6e2db59 into 1.11.0-affirm-patch Sep 22, 2026
48 of 51 checks passed
nickwu241 added a commit that referenced this pull request Sep 22, 2026
Records the Docker Hub -> Quay MinIO fix as part of 1.11.0-affirm-patch.1
now that it's merged onto 1.11.0-affirm-patch.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
nickwu241 added a commit that referenced this pull request Sep 22, 2026
…licate commits in DynamicCommitter when Flink jobId changes on restart (#10)

* Flink: Fix duplicate commits in DynamicCommitter when Flink jobId changes on restart (apache#16011)

Cherry-pick of apache#16011.

Upstream commit: apache/iceberg@c11404c

* Flink: Backport DynamicCommitter jobId fix to v1.20 and v2.0

Backport commit apache#16011.

* Pin version.txt to 1.11.0-affirm-patch.1 and add AFFIRM_VERSIONS.md

version.txt was previously untracked, so build.gradle's getProjectVersion()
silently falls back to a git-describe-derived version if the file is ever
missing from the working tree (e.g. after a checkout/clean) instead of
failing loudly. This has already caused one unintended publish under
1.10.0-SNAPSHOT.

AFFIRM_VERSIONS.md records which Affirm-local patches are carried by each
published version.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

* Remove published commit tracking from AFFIRM_VERSIONS.md

Git tags are the source of truth for the commit published to Artifactory, not this file.

* Document PR #11 (MinIO/Quay CI fix) in AFFIRM_VERSIONS.md

Records the Docker Hub -> Quay MinIO fix as part of 1.11.0-affirm-patch.1
now that it's merged onto 1.11.0-affirm-patch.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

---------

Co-authored-by: lrsb <github@lrsb.xyz>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
@nickwu241
nickwu241 deleted the nick/cherry-pick-18071-minio-quay branch September 22, 2026 23:35
nickwu241 added a commit that referenced this pull request Sep 25, 2026
* Document and stage 1.11.0-affirm-patch.2

Bumps version.txt and adds the AFFIRM_VERSIONS.md changelog entry for the next
patch release, covering the 3 review-triggered fixes from all-the-things#222721
(#12/#13/#14). Those PRs are open, not yet merged — rebase this branch onto
1.11.0-affirm-patch once they land, then tag 1.11.0-affirm-patch.2 at the
resulting commit and publish per RUNBOOK_ICEBERG_PATCH_PUBLISH.md.

* Update AFFIRM_VERSIONS.md: base off 1.11.0-affirm-patch.1, drop reviewer names

* Drop #10/#11 from .2 table (already covered by .1 base)

* Note #12/#13/#14 merged and branch rebased; ready to tag

* Drop 'not yet published' framing now that .2 contents are final

* Drop trailing note from .2 section to match .1 format
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants