On Load Testing, bitnami/kafka:3.7.0 Server Fails to Connect after working fine for so many seconds/ publishes #67986
Labels
kafka
solved
stale
15 days without activity
tech-issues
The user has a technical issue about an application
triage
Triage is needed
Name and Version
bitnami/kafka:3.7.0
What architecture are you using?
amd64
What steps will reproduce the bug?
Trying to get a working system for handling high throughput. Testing on docker windows. The setup works for manual testing, but if I use K6 to do a load test, it stops after publishing around 28000 msgs.
With the following dockercompose file [EDIT: Adding section that creates the topic]
And a Dockerfile Using Nginx Unit (FROM unit:1.32.1-php8.2) with opcache, and rdkafka extension enabled
And Producer.php
And For K6 load testing, I use the script.js below, generating a string that is some 200 bytes long, with the following setup.
With this config, I Run
docker-compose up --build
Then, k6 run script.js
After about 28000 publishes, It stops publishing, and I get the following error
K6 report is shown below.
What is the expected behavior?
The expected behavior is that the Kafka server handles the producer messages without any error. But it looks like something is getting used up. and not released for a while? I say this because If I wait for a minute or so, and restart the test, it will repeat the same behavior, stopping around 28000 messages published.
What do you see instead?
Additional information
Wonder if I am missing some configuration steps? I am testing this on Windows docker.
The text was updated successfully, but these errors were encountered: