You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the desired outcome from the user's perspective
Large messages are often fragmented into smaller partial messages, but should still be validated according to the same rules as if they are observed as a single unified value.
Acceptance criteria
Fragmented HTTP request messages can be validated or rejected; string, integer, json
Fragmented MQTT publish messages can be validated or rejected; string, integer, json
Fragmented Kafka produce messages can be validated or rejected; string, integer, json
Fragmented messages should not require buffering into a complete message before validation
Additional context
Conversion from json to avro (for example) is much more challenging to implement incrementally without buffering the complete message, so we should separate the concepts of validator and converter, supporting converters only at the kafkacache where we already have a view of the complete message by design.
Tasks
Separate the concepts of Validator and Converter in Java APIs
avroconverter should only be configurable in kafkacache by schema (not other protocols)
protobufconverter should only be configurable in kafkacache by schema (not other protocols)
all validators should only be configurable on HTTP and MQTT by schema
both validators and converters should be configurable on Kafka by schema
implement string fragmented validator
implement integer fragmented validator
implement json fragmented validator
The text was updated successfully, but these errors were encountered:
Describe the desired outcome from the user's perspective
Large messages are often fragmented into smaller partial messages, but should still be validated according to the same rules as if they are observed as a single unified value.
Acceptance criteria
string
,integer
,json
string
,integer
,json
string
,integer
,json
Additional context
Conversion from
json
toavro
(for example) is much more challenging to implement incrementally without buffering the complete message, so we should separate the concepts ofvalidator
andconverter
, supportingconverters
only at thekafka
cache
where we already have a view of the complete message by design.Tasks
Validator
andConverter
in Java APIsavro
converter
should only be configurable inkafka
cache
by schema (not other protocols)protobuf
converter
should only be configurable inkafka
cache
by schema (not other protocols)validators
should only be configurable onHTTP
andMQTT
by schemavalidators
andconverters
should be configurable onKafka
by schemastring
fragmented validatorinteger
fragmented validatorjson
fragmented validatorThe text was updated successfully, but these errors were encountered: