-
Notifications
You must be signed in to change notification settings - Fork 79
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Option to ingest Kafka String columns in Avro Utf8 format #4352
Conversation
CLA Assistant Lite bot All contributors have signed the CLA ✍️ ✅ |
I have read the CLA Document and I hereby sign the CLA |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In favor of this change, seems good. Couple of finishing points need to be addressed first.
extensions/kafka/src/main/java/io/deephaven/kafka/AvroImpl.java
Outdated
Show resolved
Hide resolved
extensions/kafka/src/main/java/io/deephaven/kafka/AvroImpl.java
Outdated
Show resolved
Hide resolved
extensions/kafka/src/main/java/io/deephaven/kafka/AvroImpl.java
Outdated
Show resolved
Hide resolved
recheck |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does this provide DHE w/ enough hooks to actually use utf8?
I see KafkaTools.avroSchemaToColumnDefinitions
, but no tie-ins w/ KafkaTools.avroSpec
. Even though you've added io.deephaven.kafka.AvroImpl.AvroConsume#useUTF8Strings
, that's a package private class, not publicly visible.
This should be fixed. I was fooled by groovy ignoring the package protection when I was testing this |
No description provided.