Skip to content

coordinator: forward merged dynamic filters to consumers - #637

Draft
jayshrivastava wants to merge 1 commit into
js/4-merge-dynamic-filtersfrom
js/5-forward-dynamic-filters
Draft

coordinator: forward merged dynamic filters to consumers#637
jayshrivastava wants to merge 1 commit into
js/4-merge-dynamic-filtersfrom
js/5-forward-dynamic-filters

Conversation

@jayshrivastava

@jayshrivastava jayshrivastava commented Aug 13, 2026

Copy link
Copy Markdown
Collaborator

Stack

This stack of PRs implements distributed dynamic filtering #528

  1. coordinator: display dynamic filters after execution #623
  2. worker: forward partial dynamic filters to coordinator #634
  3. coordinator: plan distributed dynamic filters #635
  4. coordinator: merge partial dynamic filters  #636
  5. coordinator: forward merged dynamic filters to consumers #637 <- you are here
  6. worker: apply merged dynamic filters during execution #639

Route each completed coordinator merge over the existing query-scoped task stream. Deliver updates at most once, keep runtime filtering fail-open, and release retained senders before signaling query EOS.

producer reports --> coordinator merge
                          |
                +---------+---------+
                v                   v
          consumer task 0     consumer task 1

Route each completed coordinator merge over the existing query-scoped
task stream. Deliver updates at most once, keep runtime filtering fail-open,
and release retained senders before signaling query EOS.

    producer reports --> coordinator merge
                              |
                    +---------+---------+
                    v                   v
              consumer task 0     consumer task 1
@jayshrivastava
jayshrivastava force-pushed the js/5-forward-dynamic-filters branch from 3229903 to ad77338 Compare August 13, 2026 19:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant