Skip to content

Revoke Partitions generating errors, when doing unneeded work#3063

Merged
iancooper merged 3 commits into
masterfrom
kafka_v10revokefix
Apr 21, 2024
Merged

Revoke Partitions generating errors, when doing unneeded work#3063
iancooper merged 3 commits into
masterfrom
kafka_v10revokefix

Conversation

@iancooper

Copy link
Copy Markdown
Member

The revoke partitions code was generating errors because it was committing the revoked partition list. Librdkafka is telling us about the partitions that we are losing, and the commits on those partitions. So if we try to commit them again, there is nothing to commit. Instead we need to determine if we have anything in offset storage that is not in the commits, and then commit those instead.

This code fixes that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant