Skip to content

Show each Dag only once in airflow dags list - #70934

Open
Eason09053360 wants to merge 1 commit into
apache:mainfrom
Eason09053360:fix-dags-list-duplicate-serialized-dags
Open

Show each Dag only once in airflow dags list#70934
Eason09053360 wants to merge 1 commit into
apache:mainfrom
Eason09053360:fix-dags-list-duplicate-serialized-dags

Conversation

@Eason09053360

Copy link
Copy Markdown
Contributor

Airflow 3 stores one serialized_dag row per Dag version, but airflow dags list
selected every row without filtering by version, so a Dag was printed once per
version it had.

Use the existing SerializedDagModel.read_all_dags() helper, which selects the
row with the highest version_number per dag_id.

Note that #60868 / #61077 fixed one source of spurious version growth, but
legitimate versions still accumulate whenever a Dag is edited, so the duplicate
rows remain reproducible.

closes: #60594

This supersedes #60637, which reached the same diagnosis but was closed by the
stale bot without review.


Was generative AI tooling used to co-author this PR?
  • Yes — Claude Code (Opus 5)

Generated-by: Claude Code (Opus 5) following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

Airflow 3 stores one serialized_dag row per Dag version, so every Dag with
more than one version was listed once per version.
@Eason09053360
Eason09053360 marked this pull request as ready for review August 2, 2026 05:06
@Eason09053360
Eason09053360 force-pushed the fix-dags-list-duplicate-serialized-dags branch from 90f4247 to 0ec3d95 Compare August 2, 2026 17:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

airflow dags list shows multiple copies of the same dag

1 participant