Skip to content

[v3-3-test] Speed up Trigger.clean_unused query to prevent Triggerer crashes (#68244) - #70668

Merged
potiuk merged 3 commits into
v3-3-testfrom
backport-2c1035a-v3-3-test
Jul 30, 2026
Merged

[v3-3-test] Speed up Trigger.clean_unused query to prevent Triggerer crashes (#68244)#70668
potiuk merged 3 commits into
v3-3-testfrom
backport-2c1035a-v3-3-test

Conversation

@github-actions

Copy link
Copy Markdown
Contributor
  • Use NOT EXISTS anti-join in Trigger.clean_unused instead of LEFT JOIN + aggregate

  • add FOR UPDATE SKIP LOCKED to Trigger.clean_unused to avoid deadlocks between concurrent triggerer pods

  • use with_row_locks helper and scope lock to trigger table
    (cherry picked from commit 2c1035a)

Co-authored-by: AntonioBergonzi 48454032+AntonioBergonzi@users.noreply.github.com

…crashes (#68244)

* Use NOT EXISTS anti-join in Trigger.clean_unused instead of LEFT JOIN + aggregate

* add FOR UPDATE SKIP LOCKED to Trigger.clean_unused to avoid deadlocks between concurrent triggerer pods

* use with_row_locks helper and scope lock to trigger table
(cherry picked from commit 2c1035a)

Co-authored-by: AntonioBergonzi <48454032+AntonioBergonzi@users.noreply.github.com>
@eladkal
eladkal marked this pull request as ready for review July 29, 2026 16:36
@eladkal
eladkal requested review from XD-DENG and ashb as code owners July 29, 2026 16:36
@potiuk
potiuk merged commit bb8198f into v3-3-test Jul 30, 2026
76 checks passed
@potiuk
potiuk deleted the backport-2c1035a-v3-3-test branch July 30, 2026 16:50
@github-actions github-actions Bot added this to the Airflow 3.3.2 milestone Jul 30, 2026
@github-actions

Copy link
Copy Markdown
Contributor Author

Hi maintainer, this PR was merged without a milestone set.
We've automatically set the milestone to Airflow 3.3.2 based on: merged to version branch
If this milestone is not correct, please update it to the appropriate milestone.

This comment was generated by Milestone Tag Assistant.

@vatsrahul1001 vatsrahul1001 added the type:bug-fix Changelog: Bug Fixes label Aug 3, 2026
vatsrahul1001 added a commit that referenced this pull request Aug 5, 2026
…crashes (#68244) (#70668)

* Use NOT EXISTS anti-join in Trigger.clean_unused instead of LEFT JOIN + aggregate

* add FOR UPDATE SKIP LOCKED to Trigger.clean_unused to avoid deadlocks between concurrent triggerer pods

* use with_row_locks helper and scope lock to trigger table
(cherry picked from commit 2c1035a)

Co-authored-by: AntonioBergonzi <48454032+AntonioBergonzi@users.noreply.github.com>
Co-authored-by: Rahul Vats <43964496+vatsrahul1001@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:Triggerer type:bug-fix Changelog: Bug Fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants