retry ErrOffsetsLoadInProgress errors during ConsumerGroup join #2058
Comments
dnwe
added a commit
that referenced
this issue
Apr 14, 2022
Ensures that the consumer group will retry Join and Sync group operations, if it receives a temporary OffsetsLoadInProgress error response, in the same way as it would for a RebalanceInProgress. Fixes #2058
k-wall
pushed a commit
to k-wall/sarama
that referenced
this issue
May 23, 2022
Ensures that the consumer group will retry Join and Sync group operations, if it receives a temporary OffsetsLoadInProgress error response, in the same way as it would for a RebalanceInProgress. Fixes IBM#2058
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Versions
Problem Description
The Kafka-on-Pulsar team made a change in 2.8.1 that makes transient
ErrOffsetsLoadInProgresserrors very common when a consumer joins and causes our sarama consumers to fail. The equivalent error in the Apache Kafka Java client is CoordinatorLoadInProgressException (which extends RetriableException). Because our Kafka Java consumers automatically retry they recover.I made a naive change to
newSessioninconsumer_group.go, addingErrOffsetsLoadInProgressto the retry case (without refresh) and our sarama consumers now recover from transient ErrOffsetsLoadInProgress errors.The text was updated successfully, but these errors were encountered: