Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[kafka_consumer] Partition assignment strategy should be configurable #6687

Closed
dhoppe opened this issue Nov 20, 2019 · 0 comments · Fixed by #6688
Closed

[kafka_consumer] Partition assignment strategy should be configurable #6687

dhoppe opened this issue Nov 20, 2019 · 0 comments · Fixed by #6688
Labels
feature request Requests for new plugin and for new features to existing plugins
Milestone

Comments

@dhoppe
Copy link
Contributor

dhoppe commented Nov 20, 2019

Feature Request

According to the following link, Kafka supports multiple partition assignment strategies:

Proposal:

According to the following link, Sarama is able to choose between three different partition assignment strategies. It would be great, if this could be configured via Telegraf.

Current behavior:

Only one consumer is assigned to a partition of the Kafka topic.

Desired behavior:

Multiple consumers should be able to consume from the same partition of the Kafka topic.

Use case:

In some cases the data is not balanced very well netween the partitions of a Kafka tpic. It could take really long to reduce the lag of a single partition. It would be great, if multiple consumers could consume data from a single partition (roundrobin).

@danielnelson danielnelson added this to the 1.13.0 milestone Nov 27, 2019
@danielnelson danielnelson added the feature request Requests for new plugin and for new features to existing plugins label Nov 27, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request Requests for new plugin and for new features to existing plugins
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants