Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue on kafka_consumer plugin #257

Closed
pugna0 opened this issue Oct 12, 2015 · 8 comments
Closed

Issue on kafka_consumer plugin #257

pugna0 opened this issue Oct 12, 2015 · 8 comments

Comments

@pugna0
Copy link

pugna0 commented Oct 12, 2015

Hi bro,
I clone this project from master on Ubuntu14.04.
I just put kafka plugin in the config file, and output it to influxdb.
It works well but the result is consits of "kafka_" and the data in the topic , like:
cpu_time_guest (source data )
kafka_cpu_time_guest (generated by telegraf)

and I write "aaa" into kafka , then using telegraf with that topic, this log information clearly indicate that telegraf is analyzing "aaa".
2015/10/12 17:54:53 Error in plugin [kafka] : unable to parse 'aaa': missing fields

Another problem is that telegraf just gather once in kafka, log informations as follows: 
2015/10/12 17:08:41 Cranking default (10s) interval, gathered 2900 metrics from 1 plugins in 1.302290095s
2015/10/12 17:08:50 Cranking default (10s) interval, gathered 0 metrics from 1 plugins in 1.075610727s

The final result I want is the status of kafka_consumer as "redis plugin" .

@sparrc
Copy link
Contributor

sparrc commented Oct 12, 2015

how would you expect telegraf to parse "aaa"? I believe that the kafka consumer plugin needs to be in the line-protocol format

@sparrc
Copy link
Contributor

sparrc commented Oct 12, 2015

it's also expected that telegraf plugins prepend measurements with the plugin name

@sparrc sparrc closed this as completed Oct 12, 2015
@pugna0
Copy link
Author

pugna0 commented Oct 13, 2015

I mean, the contents kafka-plugin gathered are not run-time status or performance of consumer on a topic , they are just source data. The function of kafka plugin is not like redis 's.

@sparrc
Copy link
Contributor

sparrc commented Oct 13, 2015

that is why it's called a kafka_consumer, it consumes kafka data. I suppose a statistics-gathering plugin would just be called kafka

This should be spelled out in a README, see #177

@pugna0
Copy link
Author

pugna0 commented Oct 13, 2015

Did I make a mistake? These two do not have same function?

read metrics from a Kafka topic

[kafka]

Read metrics from one or many redis servers

[redis]

@pugna0
Copy link
Author

pugna0 commented Oct 13, 2015

I copy them from config-sample.

@sparrc
Copy link
Contributor

sparrc commented Oct 13, 2015

@pugna0, correct, they don't have the same function. You can submit a PR if you would like to change the wording, and as I said you can also help the project by submitting a README.

@pugna0
Copy link
Author

pugna0 commented Oct 13, 2015

I've got it , thank you very much , I'll leave messages for you if I have any ideas.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants