-
Notifications
You must be signed in to change notification settings - Fork 467
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feature benchmark: add scenario with many Kafka sources in the same cluster #27711
feature benchmark: add scenario with many Kafka sources in the same cluster #27711
Conversation
601f107
to
6868c4d
Compare
6868c4d
to
bcedba0
Compare
I am not 100% sure if this tests what we intend. I am a bit surprised by the low wallclock duration, which is < 10 seconds... |
bcedba0
to
a32e70b
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Did you try increasing the scale? If with a larger scale it gets slower I'm ok with this.
a32e70b
to
ecc93bb
Compare
There is a difference when using more sources. With scale 2.5 (316 sources):
With scale 2.0 (100 sources):
|
Nightly: https://buildkite.com/materialize/nightly/builds?branch=nrainer-materialize%3Afeature-benchmark%2Fmany-kafka-sources