Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add partition count observability query #2081

Merged
merged 1 commit into from
Mar 7, 2018
Merged

Conversation

jtfmumm
Copy link
Contributor

@jtfmumm jtfmumm commented Mar 5, 2018

We currently have an observability query called that gets you
the distribution of particular step ids across the
cluster, but this can be unwieldy and is most useful
in the context of automated tests. This new query
returns just the number of steps on each worker broken
down by partition type.

We currently have an observability query that gets you
the distribution of particular step ids across the
cluster, but this can be unwieldy and is most useful
in the context of automated tests. This new query
returns just the number of steps on each worker broken
down by partition type.
@jtfmumm
Copy link
Contributor Author

jtfmumm commented Mar 5, 2018

@nisanharamati To test this, you use external_sender with -t partition-count-query. You should see step counts for each worker grouped by partition type (where you would have seen lists of step ids in the other partition query).

@nisanharamati nisanharamati merged commit 934f4c9 into master Mar 7, 2018
wallaroolabs-wally added a commit that referenced this pull request Mar 7, 2018
@nisanharamati nisanharamati deleted the partition-count branch March 7, 2018 20:54
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants