Repository navigation
Improve streaming ingestion completion timeout error message - #14636
Merged
AmatyaAvadhanula merged 4 commits intoAug 22, 2023
Merged
AmatyaAvadhanula merged 4 commits into
AmatyaAvadhanula merged 4 commits into
Conversation
kfaraz
reviewed
Jul 21, 2023
Comment on lines
+3275
to
+3276
| + "Please check the total time taken for each segment's creation and publish to deep storage, " | ||
| + "as well as the total time taken for segment handoff to the historicals.", |
Contributor
There was a problem hiding this comment.
Suggested change
| + "Please check the total time taken for each segment's creation and publish to deep storage, " | |
| + "as well as the total time taken for segment handoff to the historicals.", | |
| + "Check metrics to see if the creation, publish or handoff of any segment is taking longer than usual.", |
kfaraz
reviewed
Jul 21, 2023
Co-authored-by: Kashif Faraz <kashif.faraz@gmail.com>
asdf2014
requested changes
Jul 26, 2023
Co-authored-by: Benedict Jin <asdf2014@apache.org>
asdf2014
approved these changes
Jul 27, 2023
Contributor
Author
riovic918data
pushed a commit
to riovic918data/druid
that referenced
this pull request
Jun 12, 2026
…14636) * Improve streaming ingestion completion timeout error message Co-authored-by: Kashif Faraz <kashif.faraz@gmail.com> Co-authored-by: Benedict Jin <asdf2014@apache.org>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
A streaming ingestion supervisor spec has the property:
completionTimeout(defaults to 30 minutes), which is the total time to wait after the taskDuration has elapsed for the tasks to stop reading, create segments from intermediate persists, publish segments to deep storage, and finally hand them off from the peons to the historicals.A task fails if the above operations are not completed before the completionTimeout has elapsed.
This PR adds steps for better debugging when such failures occur.