GH-625: Map MinorType getNewFieldWriter returns UnionMapWriter #627
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
wsuppiger
requested review from
laurentgo,
lidavidm and
wgtmac
as code owners
This comment has been minimized.
This comment has been minimized.
lidavidm
reviewed
Feb 21, 2025
Member
lidavidm
left a comment
lidavidm
left a comment
There was a problem hiding this comment.
Thanks! Would it be possible to add a unit test somewhere?
dongjoon-hyun
pushed a commit
to apache/spark
that referenced
this pull request
May 15, 2025
### What changes were proposed in this pull request? This pr aims to upgrade `arrow-java` from 18.2.0 to 18.3.0. ### Why are the changes needed? The new version bring some bug fixes, like: - apache/arrow-java#627 - apache/arrow-java#654 - apache/arrow-java#656 - apache/arrow-java#693 - apache/arrow-java#705 - apache/arrow-java#707 - apache/arrow-java#722 In addition, the new version introduces a cascading upgrade for flatbuffers-java([ from 24.3.25 to 25.1.24 ](apache/arrow-java#600)) the full release note as follows: - https://github.com/apache/arrow-java/releases/tag/v18.3.0 ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? - Pass GitHub Acitons ### Was this patch authored or co-authored using generative AI tooling? No Closes #50892 from LuciferYang/arrow-java-18.3.0. Authored-by: yangjie01 <yangjie01@baidu.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
yhuang-db
pushed a commit
to yhuang-db/spark
that referenced
this pull request
Jun 9, 2025
### What changes were proposed in this pull request? This pr aims to upgrade `arrow-java` from 18.2.0 to 18.3.0. ### Why are the changes needed? The new version bring some bug fixes, like: - apache/arrow-java#627 - apache/arrow-java#654 - apache/arrow-java#656 - apache/arrow-java#693 - apache/arrow-java#705 - apache/arrow-java#707 - apache/arrow-java#722 In addition, the new version introduces a cascading upgrade for flatbuffers-java([ from 24.3.25 to 25.1.24 ](apache/arrow-java#600)) the full release note as follows: - https://github.com/apache/arrow-java/releases/tag/v18.3.0 ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? - Pass GitHub Acitons ### Was this patch authored or co-authored using generative AI tooling? No Closes apache#50892 from LuciferYang/arrow-java-18.3.0. Authored-by: yangjie01 <yangjie01@baidu.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
jbonofre
pushed a commit
that referenced
this pull request
Jan 26, 2026
…#985) Bumps [org.apache.commons:commons-compress](https://github.com/apache/commons-compress) from 1.27.1 to 1.28.0. <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/commons-compress/blob/master/RELEASE-NOTES.txt">org.apache.commons:commons-compress's changelog</a>.</em></p> <blockquote> <h2>Apache Commons Compress 1.28.0 Release Notes</h2> <p>The Apache Commons Compress team is pleased to announce the release of Apache Commons Compress 1.28.0.</p> <p>Apache Commons Compress defines an API for working with compression and archive formats. These include bzip2, gzip, pack200, LZMA, XZ, Snappy, traditional Unix Compress, DEFLATE, DEFLATE64, LZ4, Brotli, Zstandard and ar, cpio, jar, tar, zip, dump, 7z, arj.</p> <p>This is a feature and maintenance release. Java 8 or later is required.</p> <p>This release updates Apache Commons Lang to 3.18.0 to pick up the fix for CVE-2025-48924 (<a href="https://nvd.nist.gov/vuln/detail/CVE-2025-48924">https://nvd.nist.gov/vuln/detail/CVE-2025-48924</a>), but is not affected by it.</p> <h2>Changes in this version</h2> <p>Changes in this version include the following.</p> <h2>New Features</h2> <ul> <li> <pre><code> Add GzipParameters.getModificationInstant(). Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add GzipParameters.setModificationInstant(Instant). Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add GzipParameters.OS, setOS(OS), getOS(). Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add GzipParameters.toString(). Thanks to Gary Gregory. </code></pre> </li> <li>COMPRESS-638: Add GzipParameters.setFileNameCharset(Charset) and getFileNameCharset() to override the default ISO-8859-1 Charset <a href="https://redirect.github.com/apache/commons-compress/issues/602">#602</a>. Thanks to vincexjl, Gary Gregory, Piotr P. Karwasz.</li> <li> <pre><code> Add support for gzip extra subfields, see GzipParameters.setExtra(HeaderExtraField) [#604](apache/commons-compress#604). Thanks to ddeschenes-1, Gary Gregory. </code></pre> </li> <li> <pre><code> Add CompressFilterOutputStream and refactor to use. Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add ZipFile.stream(). Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> GzipCompressorInputStream reads the modification time (MTIME) and stores its value incorrectly multiplied by 1,000. Thanks to Danny Deschenes, Gary Gregory. </code></pre> </li> <li> <pre><code> GzipCompressorInputStream writes the modification time (MTIME) the value incorrectly divided by 1,000. Thanks to Danny Deschenes, Gary Gregory. </code></pre> </li> <li> <pre><code> Add optional FHCRC to GZIP header [#627](apache/commons-compress#627). Thanks to Danny Deschenes, Gary Gregory. </code></pre> </li> <li> <pre><code> Add GzipCompressorInputStream.Builder allowing to customize the file name and comment Charsets. Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add GzipCompressorInputStream.Builder.setOnMemberStart(IOConsumer) to monitor member parsing. Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add GzipCompressorInputStream.Builder.setOnMemberEnd(IOConsumer) to monitor member parsing. Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add PMD check to default Maven goal. Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add SevenZFile.Builder.setMaxMemoryLimitKiB(int). Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add MemoryLimitException.MemoryLimitException(long, int, Throwable) and deprecate MemoryLimitException.MemoryLimitException(long, int, Exception). Thanks to Gary Gregory. </code></pre> </li> <li>COMPRESS-692: Add support for zstd compression in zip archives. Thanks to Mehmet Karaman, Andrey Loskutov, Gary Gregory.</li> <li> <pre><code> Add support for XZ compression in ZIP archives. Thanks to Gary Gregory. </code></pre> </li> <li>COMPRESS-695: Add ZipArchiveInputStream.createZstdInputStream(InputStream) to provide a different InputStream implementation for Zstandard (Zstd) <a href="https://redirect.github.com/apache/commons-compress/issues/649">#649</a>. Thanks to Gary Gregory.</li> <li> <pre><code> Add org.apache.commons.compress.harmony.pack200.Pack200Exception.Pack200Exception(String, Throwable). Thanks to Gary Gregory. </code></pre> </li> <li>COMPRESS-697: Move BitStream.nextBit() method to BitInputStream <a href="https://redirect.github.com/apache/commons-compress/issues/663">#663</a>. Thanks to Fredrik Kjellberg, Gary Gregory.</li> <li> <pre><code> Add org.apache.commons.compress.compressors.lzma.LZMACompressorInputStream.builder/Builder(). Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add org.apache.commons.compress.compressors.lzma.LZMACompressorOutputStream.builder/Builder(). Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add org.apache.commons.compress.compressors.xz.XZCompressorInputStream.builder/Builder(). Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add org.apache.commons.compress.compressors.xz.XZCompressorOutputStream.builder/Builder(). Thanks to Gary Gregory. </code></pre> </li> <li> <pre><code> Add org.apache.commons.compress.compressors.xz.ZstdCompressorOutputStream.builder/Builder() [#666](apache/commons-compress#666). Thanks to Gary Gregory, David Walluck, Piotr P. Karwasz. </code></pre> </li> <li> <pre><code> Add org.apache.commons.compress.compressors.xz.ZstdConstants [#666](apache/commons-compress#666). Thanks to Gary Gregory, David Walluck, Piotr P. Karwasz. </code></pre> </li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/commons-compress/commit/852d9c23b94127feafc1649d9c7f13d4df338845"><code>852d9c2</code></a> Prepare for the release candidate 1.28.0 RC1</li> <li><a href="https://github.com/apache/commons-compress/commit/f5eb9e28edf8a661ac5efc43b7853ee49bb73b3a"><code>f5eb9e2</code></a> Prepare for the next release candidate</li> <li><a href="https://github.com/apache/commons-compress/commit/36f204caa6f7bb2c92a9ad04ba246ad47a2465d2"><code>36f204c</code></a> Camel case parameter name</li> <li><a href="https://github.com/apache/commons-compress/commit/4c04e4a803831c00663a6dafd0f0837fba60633b"><code>4c04e4a</code></a> Use final</li> <li><a href="https://github.com/apache/commons-compress/commit/6cb7da194a9369edfbd65629576203b8af61ba44"><code>6cb7da1</code></a> Javadoc</li> <li><a href="https://github.com/apache/commons-compress/commit/563c9d2fa4d2340902284fc044a7398fc15da5fb"><code>563c9d2</code></a> Javadoc</li> <li><a href="https://github.com/apache/commons-compress/commit/ce73bd890e50fcb88d362fc8298f31fa90d802aa"><code>ce73bd8</code></a> Javadoc</li> <li><a href="https://github.com/apache/commons-compress/commit/a464ae94e0f9c59e9bc30be6086d876f9907d0a4"><code>a464ae9</code></a> Better parameter names</li> <li><a href="https://github.com/apache/commons-compress/commit/c0b2b84144d923a2bf7caada35e1d9bb5d562e78"><code>c0b2b84</code></a> Add TODO for next major version</li> <li><a href="https://github.com/apache/commons-compress/commit/c76bc976703dc0cebfb6d4653061b8ac3524421d"><code>c76bc97</code></a> Use OpenVEX to document that we are not affected by CVE-2025-48924 in</li> <li>Additional commits viewable in <a href="https://github.com/apache/commons-compress/compare/rel/commons-compress-1.27.1...rel/commons-compress-1.28.0">compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What's Changed
Closes #625