Skip to content

ci: Upgrade zstd to match dependency of parquet-hadoop 1.18.1 #20296

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
kfaraz wants to merge 2 commits into from
Closed

ci: Upgrade zstd to match dependency of parquet-hadoop 1.18.1 #20296

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
5f980ca
Upgrade zstd to match dependency of parquet-hadoop 1.18.1
kfaraz Sep 8, 2026
814f8b2
Fix licenses.yaml
kfaraz Sep 8, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion licenses.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3698,7 +3698,7 @@ name: JNI binding for Zstd
license_category: binary
module: java-core
license_name: BSD-2-Clause License
version: 1.5.7-11
version: 1.5.7-15
copyright: Luben Karavelov
license_file_path: licenses/bin/zstd-jni.BSD2
libraries:
Expand Down
2 changes: 1 addition & 1 deletion pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -706,7 +706,7 @@
<dependency>
<groupId>com.github.luben</groupId>
<artifactId>zstd-jni</artifactId>
<version>1.5.7-11</version>
<version>1.5.7-15</version>

@FrankChen021 FrankChen021 Sep 8, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[P2] Upgrading past -12 drops legacy Zstandard decoding

zstd-jni documents 1.5.7-12 as the last release that supports the legacy 0.4–0.7 formats; 1.5.7-15 removes them (see https://github.com/luben/zstd-jni#status-and-availability). Druid exposes .zst as a supported batch-ingestion format, and processing/src/main/java/org/apache/druid/utils/CompressionUtils.java:808-809 constructs ZstdCompressorInputStream from this same dependency, so existing legacy .zst inputs that worked with 1.5.7-11 will now fail during ingestion. Please retain a legacy-capable version (if Parquet works with it) or explicitly handle, document, and test this compatibility break before merging.

</dependency>
<dependency>
<groupId>com.fasterxml.jackson</groupId>
Expand Down
Loading