cdc: Batch writes to sinks in Kafka consumer #395
Comments
pingyu
added a commit
that referenced
this issue
Mar 5, 2024
* collect pprof heap Signed-off-by: Ping Yu <yuping@pingcap.com> * unlimit retry for pd connection Signed-off-by: Ping Yu <yuping@pingcap.com> * reduce record size Signed-off-by: Ping Yu <yuping@pingcap.com> * log level: info Signed-off-by: Ping Yu <yuping@pingcap.com> * reduce data size; add grafana panel Signed-off-by: Ping Yu <yuping@pingcap.com> * batch Signed-off-by: Ping Yu <yuping@pingcap.com> * fix Signed-off-by: Ping Yu <yuping@pingcap.com> * try debug Signed-off-by: Ping Yu <yuping@pingcap.com> * fix encoder size Signed-off-by: Ping Yu <yuping@pingcap.com> * fix Signed-off-by: Ping Yu <yuping@pingcap.com> * MQMessage pool Signed-off-by: Ping Yu <yuping@pingcap.com> * fix release Signed-off-by: Ping Yu <yuping@pingcap.com> * wip Signed-off-by: Ping Yu <yuping@pingcap.com> * fix flaky ut Signed-off-by: Ping Yu <yuping@pingcap.com> * logging Signed-off-by: Ping Yu <yuping@pingcap.com> * fix ut Signed-off-by: Ping Yu <yuping@pingcap.com> * wip Signed-off-by: Ping Yu <yuping@pingcap.com> * adjust memory release parameter Signed-off-by: Ping Yu <yuping@pingcap.com> * polish Signed-off-by: Ping Yu <yuping@pingcap.com> * polish Signed-off-by: Ping Yu <yuping@pingcap.com> * polish Signed-off-by: Ping Yu <yuping@pingcap.com> * polish Signed-off-by: Ping Yu <yuping@pingcap.com> * fix ut Signed-off-by: Ping Yu <yuping@pingcap.com> * polish Signed-off-by: Ping Yu <yuping@pingcap.com> --------- Signed-off-by: Ping Yu <yuping@pingcap.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Feature Request
Is your feature request related to a problem? Please describe:
Describe the feature you'd like:
Batch writes to sinks in Kafka consumer. Otherwise the efficiency is low.
Describe alternatives you've considered:
Teachability, Documentation, Adoption, Migration Strategy:
The text was updated successfully, but these errors were encountered: