Upgrade streaming based sinks #2642
Labels
domain: sinks
Anything related to the Vector's sinks
sink: kafka
Anything `kafka` sink related
sink: papertrail
Anything `papertrail` sink related
sink: pulsar
Anything `pulsar` sink related
sink: socket
Anything `socket` sink related
sink: vector
Anything `vector` sink related
type: tech debt
A code change that does not add user value.
Comments
LucioFranco
added
sink: socket
binarylogic
added this to the
Tech-Debt Payment #1: Move to Tokio 0.2/Futures 0.3 milestone
binarylogic
removed this from the
Tech-Debt Payment #1: Move to Tokio 0.2/Futures 0.3 milestone
binarylogic
added
the
type: tech debt
|
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
This is a tracking issue to track sinks that don't follow our other service or http based sinks. These sinks are based around the
StreamingSinktype and do not do any sort of batching.Sinks to upgrade
kafkapulsarsocketpapertrailvectorNotes
These sinks will be a bit more complicated to upgrade for two reasons 1) currently vector is not using the new
Sinkapi (nor should it) 2) upgrading the libraries might remove the option to use poll based apis.Suggestions here might be to use the new
streaming_sinkintegrations and working directly with async/await instead of poll. This means the upgrade will be a bit more invasive.There has been more discussion around this design here. #2122
The text was updated successfully, but these errors were encountered: