Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Metricbeat] Investigate collection period=1m for googlecloud module #17141

Closed
kaiyan-sheng opened this issue Mar 19, 2020 · 3 comments · Fixed by #17719
Closed

[Metricbeat] Investigate collection period=1m for googlecloud module #17141

kaiyan-sheng opened this issue Mar 19, 2020 · 3 comments · Fixed by #17719
Assignees
Labels
discuss Issue needs further discussion. Metricbeat Metricbeat Team:Platforms Label for the Integrations - Platforms team

Comments

@kaiyan-sheng
Copy link
Contributor

By looking at monitoring metrics on google cloud platform console, they ones I saw all have 1 minute interval. For example:
Screen Shot 2020-03-19 at 2 44 11 PM

Also with current code, when period = 5min is set, metrics are collected per minute for 2 or 3 out of the 5 minutes. I would like to see either collecting every minute in each 5-minute instead of partially. Please see kibana snapshot for this:
Screen Shot 2020-03-09 at 1 12 13 PM

@kaiyan-sheng kaiyan-sheng self-assigned this Mar 19, 2020
@kaiyan-sheng kaiyan-sheng added discuss Issue needs further discussion. Metricbeat Metricbeat Team:Platforms Label for the Integrations - Platforms team labels Mar 19, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-platforms (Team:Platforms)

@kaiyan-sheng
Copy link
Contributor Author

GCP monitoring metrics latency: Sampled every 60 seconds. After sampling, data is not visible for up to 240 seconds.

@exekias
Copy link
Contributor

exekias commented Mar 26, 2020

We had a chat about this and I think we need to change some things. It sounds like we should collect more often but account for the 240 seconds delay when choosing the time range. Also find a way to avoid sending duplicate data

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discuss Issue needs further discussion. Metricbeat Metricbeat Team:Platforms Label for the Integrations - Platforms team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants