Skip to content

Add logic to mark backfills as complete - #42683

Merged
dstandish merged 5 commits into
apache:mainfrom
astronomer:aip-78-add-logic-to-mark-backfills-as-complete
Oct 14, 2024
Merged

Add logic to mark backfills as complete#42683
dstandish merged 5 commits into
apache:mainfrom
astronomer:aip-78-add-logic-to-mark-backfills-as-complete

Conversation

@dstandish

@dstandish dstandish commented Oct 2, 2024

Copy link
Copy Markdown
Contributor

Check periodically for backfills that are now complete.


depends on #42686

@boring-cyborg boring-cyborg Bot added the area:Scheduler including HA (high availability) scheduler label Oct 2, 2024
@dstandish
dstandish force-pushed the aip-78-add-logic-to-mark-backfills-as-complete branch from 0a2cb45 to e456618 Compare October 7, 2024 14:12
@dstandish
dstandish marked this pull request as ready for review October 7, 2024 15:42
@dstandish
dstandish force-pushed the aip-78-add-logic-to-mark-backfills-as-complete branch from 7eaa741 to 520def0 Compare October 9, 2024 22:27
@jedcunningham

Copy link
Copy Markdown
Member

I do wonder if it'd be better to check when setting the dagrun state instead of adding to the EventScheduler. But the "best" option is probably situational, so I'm fine with it this way.

@dstandish
dstandish merged commit 72da8f6 into apache:main Oct 14, 2024
@dstandish
dstandish deleted the aip-78-add-logic-to-mark-backfills-as-complete branch October 14, 2024 02:40
@dstandish

Copy link
Copy Markdown
Contributor Author

I do wonder if it'd be better to check when setting the dagrun state instead of adding to the EventScheduler. But the "best" option is probably situational, so I'm fine with it this way.

Yeah, reasonable. I would be fine either way. And, we could change it later to be that way since it's not user-facing code.

pavansharma36 pushed a commit to pavansharma36/airflow that referenced this pull request Oct 14, 2024
Periodically check for backfills that should be marked as complete.
R7L208 pushed a commit to R7L208/airflow that referenced this pull request Oct 17, 2024
Periodically check for backfills that should be marked as complete.
harjeevanmaan pushed a commit to harjeevanmaan/airflow that referenced this pull request Oct 23, 2024
Periodically check for backfills that should be marked as complete.
PaulKobow7536 pushed a commit to PaulKobow7536/airflow that referenced this pull request Oct 24, 2024
Periodically check for backfills that should be marked as complete.
ellisms pushed a commit to ellisms/airflow that referenced this pull request Nov 13, 2024
Periodically check for backfills that should be marked as complete.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:Scheduler including HA (high availability) scheduler

Projects

No open projects

Development

Successfully merging this pull request may close these issues.

2 participants