Repository navigation

[SPARK-57152][SDP] Implement SCD2 Batch Processor; Find Affected Aux/Target Table Rows - #56283

Closed

AnishMahto wants to merge 20 commits into

apache:masterfrom

AnishMahto:SPARK-57152-SCD2-find-affected-rows

Closed

[SPARK-57152][SDP] Implement SCD2 Batch Processor; Find Affected Aux/Target Table Rows#56283
AnishMahto wants to merge 20 commits into
apache:masterfrom
AnishMahto:SPARK-57152-SCD2-find-affected-rows

Commits on Jun 2, 2026
- SCD2 preprocess microbatch
  AnishMahto
  committed
  f579359
- add scaladocs
  AnishMahto
  committed
  3a34e55
- fixing indenting
  AnishMahto
  committed
  b77e557
- document decomposition tail concept
  AnishMahto
  committed
  437bfa4
- document event deduplication responisbilities and add test
  AnishMahto
  committed
  75adaa5
- core implementation
  AnishMahto
  committed
  35b9d51
- tests
  AnishMahto
  committed
  95d7280
- some test cleanup
  AnishMahto
  committed
  841bcd9
- cleanup tests
  AnishMahto
  committed
  53a3c5d
- cleanup
  AnishMahto
  committed
  7e28a20
Commits on Jun 3, 2026
- PR feedbavk
  AnishMahto
  committed
  8fbca9f
- link TODO
  AnishMahto
  committed
  f2f6282
- Merge branch 'SPARK-57134-SCD2-preprocess-microbatch' into SPARK-57152-SCD2-find-affected-rows
  AnishMahto
  committed
  d7cc05d
- test cleanup
  AnishMahto
  committed
  8893202
Commits on Jun 4, 2026
- lift deletedByBatchId into its own column
  AnishMahto
  committed
  33892d6
- self-review and cleanup
  AnishMahto
  committed
  4f8e5e1
- Merge branch 'master' into SPARK-57152-SCD2-find-affected-rows
  AnishMahto
  committed
  e441d38
Commits on Jun 5, 2026
- PR feedback
  AnishMahto
  committed
  b5abfad
Commits on Jun 8, 2026
- whitespace linting
  AnishMahto
  committed
  d12eefb
- scaladoc phrasing
  AnishMahto
  committed
  84011d2