Problem to connect to cluster

[justjoheinz]

When I try the simple demo snippets in the README or run the test suite using docker I will get errors like this one:

test-test-1  | TEST/HIGH-LEVEL/ADMIN::CREATE-PARTITIONS-WITH-PRODUCER%3|1675427948.113|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#172.22.0.3:9092 failed: Connection refused (after 0ms in state CONNECT)
test-test-1  | %3|1675427948.113|ERROR|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: 1/1 brokers are down
test-test-1  | %3|1675427948.118|FAIL|rdkafka#producer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#172.22.0.3:9092 failed: Connection refused (after 0ms in state CONNECT)
test-test-1  | Unhandled CL-RDKAFKA:KAFKA-ERROR in thread #<SB-THREAD:THREAD "cl-rdkafka" RUNNING
test-test-1  |                                               {1004234173}>:
test-test-1  |   Expected event-type `1`, not `8`
test-test-1  |
test-test-1  | Backtrace for: #<SB-THREAD:THREAD "cl-rdkafka" RUNNING {1004234173}>

I am working on an M1 Mac with librdkafka installed via homebrew. I can reach the kafka instance running inside of docker with command line tools such as kafka-topics --bootstrap-servers 127.0.0.1:9092 --list etc. But not via Common Lisp. Any ideas?

[justjoheinz]

Additional info:

it seems that the code never returns from ( kf:flush producer) using the producer example from the readme.

[SahilKang]

The error you're seeing looks to be something from librdkafka: the producer is getting an error event instead of an expected delivery report.

If this is happening consistently, then I think the best way to debug would be to put together a minimal C program that accomplishes the same thing as the README producer example. That should clearly narrow it down to either cl-rdkafka or librdkafka