docs: clarify Redis maintenance for CeleryExecutor - #67393
Conversation
|
What's the motivation behind adding this? |
|
The motivation is to make the Redis maintenance boundary explicit for CeleryExecutor users. The linked issue asks what Airflow stores in Redis and whether it is safe to clean it. Today the docs explain Redis as the broker, but they do not clearly distinguish broker-side transient Celery state from the Airflow metadata database, nor warn that flushing Redis while schedulers/workers are active can drop queued work or make task state inconsistent. This section is meant to prevent operators from treating Redis cleanup like |
|
This pull request has been automatically marked as stale because the author has not responded to a request for more information. It will be closed in 7 days if no further activity occurs. Thank you for your contributions. |
potiuk
left a comment
There was a problem hiding this comment.
Docs-only — accurate Redis-broker maintenance guidance for the Celery executor. Verified the diff. LGTM.
|
Awesome work, congrats on your first merged pull request! You are invited to check our Issue Tracker for additional contributions. |
Closes #55215.\n\nAdds a Redis maintenance section to the CeleryExecutor docs explaining what Airflow stores in Redis when it is used as the Celery broker, how that differs from the metadata database, when cleanup is appropriate, and why Redis should not be flushed while schedulers or workers are running.\n\nValidation:\n- git diff --check -- providers/celery/docs/celery_executor.rst\n- rg -n Redis maintenance providers/celery/docs/celery_executor.rst