Repository navigation

[SPARK-50593][SQL] SPJ: Support truncate transform via generalized ReducibleFunction API - #55885

Open

metanil wants to merge 32 commits into

apache:masterfrom

metanil:SPARK-50593-truncate_spj_support

Commits on May 28, 2026
Commits on Jun 3, 2026
- [SPARK-50593][SQL] Make SPJ compatibility and reducer checks nested-transform aware
  metanil
  committed
  721f576
Commits on Jun 4, 2026
- [SPARK-50593][SQL] Restore strict SPJ transform gate, keep recursive isSameFunction
  metanil
  committed
  9a70695
Commits on Jun 18, 2026
- [SPARK-50593][SQL] Replace ReducibleParameters with V2 Literal[] in the reducer API
  metanil
  authored
  28368ca
Commits on Jun 19, 2026
- [SPARK-50593][SQL] Reject non-scalar literal params in the reducer API
  metanil
  committed
  9d92888
Commits on Jun 20, 2026
- [SPARK-50593][SQL] Share childrenMatch helper for reducer layout check; stamp reducer API @since 4.3.0
  metanil
  committed
  7ea6de9
Commits on Jun 29, 2026
- [SPARK-50593][SQL] Skip SPJ reduction when a transform's literal param type doesn't match
  metanil
  committed
  8614b01
Commits on Jul 8, 2026
- [SPARK-50593][SQL] Generalized-first SPJ reducer dispatch with param-type and arity guards
  metanil
  committed
  551fe55
Commits on Jul 9, 2026
- Merge remote-tracking branch 'upstream/master' into SPARK-50593-truncate_spj_support
  metanil
  committed
  6ee8de8
Commits on Sep 22, 2026
Commits on Sep 23, 2026
- [SPARK-50593][SQL] Treat an unreadable argument type as not matching in the reducer gates
  metanil
  committed
  7867a39
- [SPARK-50593][SQL] Resolve any NamedReference in a transform argument; document sorted_bucket
  metanil
  committed
  fd7f630
Commits on Sep 24, 2026
Commits on Sep 25, 2026
Commits on Oct 1, 2026