Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some partitions occasionally fail to be consumed when a single client consumes multiple partitions. #4824

Open
7 tasks done
Ocean52-XIE opened this issue Aug 22, 2024 · 2 comments

Comments

@Ocean52-XIE
Copy link

Ocean52-XIE commented Aug 22, 2024

Description

When a client consumes multiple partitions, there is a probability that some partitions cannot be consumed.
Normal when one client consumes one partition.

When it's abnormal just jump partition 3
image
image
image
image

will recover when restart the client
image

How to reproduce
Create a topic with 8 partitions and use a client to consume

Checklist

IMPORTANT: We will close issues where the checklist has not been completed.

Please provide the following information:

  • librdkafka version (2.5.0): <REPLACE with e.g., v0.10.5 or a git sha. NOT "latest" or "current">
  • Apache Kafka version: <REPLACE with e.g., 0.10.2.3>
  • librdkafka client configuration: <REPLACE with e.g., message.timeout.ms=123, auto.reset.offset=earliest, ..>
  • Operating system: <REPLACE with e.g., Centos 5 (x64)>
  • Provide logs (with debug=.. as necessary) from librdkafka
  • Provide broker log excerpts
  • Critical issue
@anchitj
Copy link
Member

anchitj commented Aug 27, 2024

Can you provide debug logs?

@emasab
Copy link
Contributor

emasab commented Oct 15, 2024

+1 for debug logs as we can verify if it's related to this bug
#4804

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants