Repository navigation
Automatic cleanup druid_tasks table of metastore #5994
Description
druid_tasks table stores all submitted tasks to overlords. Since this is never cleaned up automatically, it always grows as more tasks are submitted until people tidy up it manually.
So, it makes sense to periodically delete old entries from that table as the coordinator does for old segments. I think it also makes sense to delete old entries if druid.indexer.logs.kill.enabled option is set because deleting task logs usually mean you don't want to check that task anymore.
Activity
jihoonson commentedon Jul 11, 2018
Related to #5979 (comment).
stale commentedon Jun 21, 2019
This issue has been marked as stale due to 280 days of inactivity. It will be closed in 2 weeks if no further activity occurs. If this issue is still relevant, please simply write any comment. Even if closed, you can still revive the issue at any time or discuss it on the dev@druid.apache.org list. Thank you for your contributions.
xvrl commentedon Feb 3, 2022
@jihoonson @gianm wasn't this fixed by #6592 ?
gianm commentedon Feb 3, 2022
Certainly looks like it.
maytasm commentedon Feb 3, 2022
I have recently tested this and
druid.indexer.logs.killdoes remove both the log file and the task metadata.xvrl commentedon Feb 3, 2022
ok, I'll close it then. We can reopen if we missed anything