From da03cdd0758b9e82f42545e446dd97e0b8a8ef41 Mon Sep 17 00:00:00 2001 From: Amogh Desai Date: Fri, 31 Jul 2026 00:49:29 +0530 Subject: [PATCH] [v3-3-test] Document effect of state-store cleanup in ResumableJobMixin (#70718) (cherry picked from commit cea9e6efdb5b23d8381bb930762f2e8d89643857) Co-authored-by: Amogh Desai --- task-sdk/docs/resumable-job-mixin.rst | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/task-sdk/docs/resumable-job-mixin.rst b/task-sdk/docs/resumable-job-mixin.rst index 345fc4c4494fb..52e0b004792a0 100644 --- a/task-sdk/docs/resumable-job-mixin.rst +++ b/task-sdk/docs/resumable-job-mixin.rst @@ -111,6 +111,14 @@ to check the current state of the job: If the worker crashes in that gap, the next retry does not have the identifier and will submit a fresh job. For most workloads this window is negligible. +.. note:: + + The stored identifier expires after ``[state_store] default_retention_days`` (30 days by + default), but nothing deletes it automatically, that only happens when someone runs + ``airflow state-store clean``. Do not run that command while a task's ``retry_delay`` is + longer than ``default_retention_days``, the identifier could be gone by the next retry, + causing the operator to submit a fresh job instead of reconnecting. + Example -------