Skip to content

Avoid JVM shuffle when parent stage will just convert back to rows #4004

Closed
#4010
Closed
Avoid JVM shuffle when parent stage will just convert back to rows#4004
#4010
Assignees
andygrove
Labels
enhancementNew feature or requestperformancerequires-triage
Milestone
0.16.0 (May 2026)

Description

@andygrove
andygrove
opened on Apr 20, 2026

What is the problem the feature request solves?

Example from TPC-DS q1:

      :     :           +- HashAggregate
      :     :              +- CometNativeColumnarToRow
      :     :                 +- CometColumnarExchange
      :     :                    +- HashAggregate

Describe the potential solution

No response

Additional context

No response

Activity

  1. andygrove
    added
    enhancementNew feature or request
    on Apr 20, 2026
  2. github-actions
    added
    requires-triage
    on Apr 20, 2026
  3. andygrove
    self-assigned this
    on Apr 20, 2026
  4. andygrove
    added
    performance
    on Apr 20, 2026
  5. andygrove
    added this to the 0.16.0 milestone on Apr 20, 2026
  6. andygrove
    added a commit that references this issue on Apr 23, 2026

    feat: avoid JVM shuffle when sandwiched between non-Comet operators

    82ec31c
  7. andygrove
    closed this as completedin #4010on Apr 25, 2026
  8. andygrove
    moved this to In progress in Comet Developmenton May 6, 2026
  9. andygrove
    added this to Comet Developmenton May 6, 2026
  10. github-project-automation
    moved this from In progress to Done in Comet Developmenton May 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestperformancerequires-triage

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions