Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka message channel #407

Merged
merged 16 commits into from
Nov 10, 2024
Merged

Kafka message channel #407

merged 16 commits into from
Nov 10, 2024

Conversation

dgafka
Copy link
Member

@dgafka dgafka commented Nov 10, 2024

Why is this change proposed?

This provides Kafka as Message Channel

Pull Request Contribution Terms

  • I have read and agree to the contribution terms outlined in CONTRIBUTING

@dgafka dgafka merged commit da549ce into main Nov 10, 2024
65 checks passed
@dgafka dgafka deleted the kafka-message-channel branch November 10, 2024 19:16
@@ -2,7 +2,7 @@ version: "3.8"

services:
app:
image: simplycodedsoftware/php:8.3.13
image: simplycodedsoftware/php:8.3.10
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why?)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is no 8.3.13, that had to be some bug

/**
* licence Enterprise
*/
final class KafkaChannelAdapterTest extends TestCase
{
public function test_sending_and_receiving_from_kafka_topic(): void
{
$this->markTestSkipped('CI yet to be setup');
$this->markTestSkipped('Kafka not yet supported');
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I do have to disable those tests on CI, because consumption does not work for some reason.
Locally it does work as expected.

@lifinsky any thoughts?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What was the error during CI?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is no specific error, it just does not see any messages.
Either the topic is not available, or the consumer is somehow not able to consume the messages

@@ -90,7 +90,7 @@ public function requeue(): void
// what to do here?
// $this->consumer->pausePartitions([$this->message->partition]);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is using Kafka as Queue based mechanism, because in reality this message is still in the topic.

But, ye I will most likely follow on this. This make sense for Message Channels, where there is only single consumer group.
It does not make sense however for Inbound Adapter, as in there we may consume from topic that is consumed by multiple consumer groups. So republishing it to the same topic, could affect other parties

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants