Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Monitoring] Ensure monitoring bulk uploader and stats api are more closely aligned #73325

Merged
merged 3 commits into from
Jul 31, 2020

Conversation

chrisronline
Copy link
Contributor

The stack monitoring team maintains a set of parity tests between legacy and metricbeat collection, and we recently noticed failures as a result of #70677 in relation to the kibana_stats.usage.search data set. The metricbeat-collected document didn't contain the total field whereas the legacy-collected document did. After digging a bit, the total field does not actually come from the newly added collector, but rather it's from an older one: https://github.com/elastic/kibana/blob/master/src/plugins/kibana_usage_collection/server/collectors/kibana/get_saved_object_counts.ts#L73.

The parity test failure is a result of handling key merging differently: using defaultsDeep in legacy collection and using object spreading for metricbeat collection.

This PR ensures we use the same merging in both places

@chrisronline chrisronline added review Team:Monitoring Stack Monitoring team v8.0.0 release_note:skip Skip the PR/issue when compiling release notes v7.10.0 labels Jul 27, 2020
@chrisronline chrisronline requested a review from a team as a code owner July 27, 2020 18:01
@chrisronline chrisronline self-assigned this Jul 27, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/stack-monitoring (Team:Monitoring)

@chrisronline chrisronline added this to the Stack Monitoring UI 7.10 milestone Jul 30, 2020
@chrisronline
Copy link
Contributor Author

@elasticmachine merge upstream

@chrisronline
Copy link
Contributor Author

@elasticmachine merge upstream

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

Build metrics

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@chrisronline chrisronline merged commit 9a1a6d3 into elastic:master Jul 31, 2020
@chrisronline chrisronline deleted the stats_match_bulk_uploader branch July 31, 2020 14:05
chrisronline added a commit to chrisronline/kibana that referenced this pull request Jul 31, 2020
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
chrisronline added a commit that referenced this pull request Jul 31, 2020
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
@chrisronline
Copy link
Contributor Author

Backport:

7.x: 88d1b2e

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release_note:skip Skip the PR/issue when compiling release notes review Team:Monitoring Stack Monitoring team v7.10.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants