Consider usage of the confluent kafkajs library

[demetris-manikas]

Hi.
Just stumbled on https://github.com/confluentinc/confluent-kafka-javascript/tags
Maybe it is about time to check out the new client as it has reached the 1.0.0 version.
1.0.0 is not exactly production ready but it should not be a while before it reaches real production ready status.

[chuck-dbos]

Had this basically working back in July:
https://github.com/dbos-inc/dbos-transact-ts/tree/chuck/ckafka

If you'd put it to use, we can prioritize getting it updated to the newer package, updating to our new TS API, and merging.

Are you looking to produce or consume messages, or both?

[demetris-manikas]

Hi,
I am looking to both produce and receive messages.

I see there is a producer communicator implementation in chuck/ckafka which is really cool to have!.
It is certainly missing from the current implementation (maybe add it in a separate PR?).

I will certainly make use of the confluence kafka client.
I use KRaft which has already produced some hiccups to DBOS-transact.

dbos-transact-ts/src/kafka/kafka.ts

Line 50 in 8f0652b

// A temporary workaround for https://github.com/tulios/kafkajs/pull/1558 until it gets fixed

Still the main concern here is to gradually move to a library with a future instead of relying on an unmaintained one.