Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow node/namespace metadata to be disabled on kubernetes metagen and ensure add_kubernetes_metadata honors host #23012

Merged
merged 3 commits into from
Dec 14, 2020

Conversation

vjsamuel
Copy link
Contributor

@vjsamuel vjsamuel commented Dec 9, 2020

What does this PR do?

There can always be reason to disable additional metadata. Having flexibility is nice to have. https://github.com/elastic/beats/pull/22189/files#diff-795a7b218ad6ff27d43bc453ecce7984c3d816537b1afc9cfc9000d5d574119eR181 introduced an issue of pulling all node metadata even if running on a daemonset. This PR fixes that behavior

Why is it important?

we dont see the need for each metric to have all labels when being ingested. the lack of node name being passed ot the node watcher causes too much churn on the API server on large clusters.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Author's Checklist

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Dec 9, 2020
@elasticmachine
Copy link
Collaborator

elasticmachine commented Dec 9, 2020

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Started by user Chris Mark

  • Start Time: 2020-12-14T20:33:42.249+0000

  • Duration: 57 min 51 sec

Test stats 🧪

Test Results
Failed 0
Passed 17462
Skipped 1379
Total 18841

Steps errors 2

Expand to view the steps failures

Terraform Apply on x-pack/metricbeat/module/aws
  • Took 0 min 15 sec . View more details on here
Terraform Apply on x-pack/metricbeat/module/aws
  • Took 0 min 16 sec . View more details on here

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test Results
Failed 0
Passed 17462
Skipped 1379
Total 18841

@andresrc andresrc added the Team:Platforms Label for the Integrations - Platforms team label Dec 9, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-platforms (Team:Platforms)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Dec 9, 2020
@vjsamuel vjsamuel changed the title Allow node/namespace metadata to be disabled on kubernetes metagen Allow node/namespace metadata to be disabled on kubernetes metagen and ensure add_kubernetes_metadata honors host Dec 14, 2020
Copy link
Member

@ChrsMark ChrsMark left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, thanks @vjsamuel!

@ChrsMark ChrsMark self-assigned this Dec 14, 2020
@ChrsMark ChrsMark added v7.11.0 needs_backport PR is waiting to be backported to other branches. labels Dec 14, 2020
Copy link
Member

@ChrsMark ChrsMark left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for adding the docs @vjsamuel !

@ChrsMark ChrsMark merged commit 20c7da2 into elastic:master Dec 14, 2020
ChrsMark pushed a commit to ChrsMark/beats that referenced this pull request Dec 14, 2020
…d ensure add_kubernetes_metadata honors host (elastic#23012)

(cherry picked from commit 20c7da2)
@ChrsMark ChrsMark removed the needs_backport PR is waiting to be backported to other branches. label Dec 14, 2020
kaiyan-sheng pushed a commit that referenced this pull request Dec 15, 2020
…d ensure add_kubernetes_metadata honors host (#23012) (#23127)

(cherry picked from commit 20c7da2)

Co-authored-by: Vijay Samuel <vjsamuel@ebay.com>
@vjsamuel vjsamuel deleted the allow_meta_disable branch December 16, 2020 06:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:Platforms Label for the Integrations - Platforms team v7.11.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants