You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Avoid CometColumnarExchange when next query stage requires CometColumnarToRow #2880
Presumably the first HashAggregate shown here is not supported by Comet (fallback reasons are missing for some reason) so this query stage needs to call CometColumnarToRow.
There is probably no benefit in using columnar shuffle in the child stage if the parent stage immediately converts back to row-based, although we should confirm that assumption.
This is the same shape as #4004, which #4010 fixed by reverting a Comet columnar shuffle to a Spark shuffle when both its parent and child are Spark hash aggregates. The pattern no longer appears in any of the TPC-DS golden plans, and the broader question of when Comet should decline a stage is tracked in #4005.
Activity
andygrove commentedon Sep 28, 2026
This is the same shape as #4004, which #4010 fixed by reverting a Comet columnar shuffle to a Spark shuffle when both its parent and child are Spark hash aggregates. The pattern no longer appears in any of the TPC-DS golden plans, and the broader question of when Comet should decline a stage is tracked in #4005.