add plugins under /opt/kafka/plugins/
-
mysql
curl -k -SL "http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz" | tar -xzf - -C /tmp/quickstart/jars --strip-components=1 mysql-connector-java-5.1.37/mysql-connector-java-5.1.37-bin.jar -
elasticsearch
-
s3
docker run --workdir /app/src -v ${PWD}:/app/src --rm maven:3.6.3-jdk-8-slim mvn package -DskipTests
Check configured connector plugins
curl localhost:8083/connector-plugins | jq
[
{
"class": "com.eneco.trading.kafka.connect.twitter.TwitterSinkConnector",
"type": "sink",
"version": ""
},
{
"class": "com.eneco.trading.kafka.connect.twitter.TwitterSourceConnector",
"type": "source",
"version": ""
},
{
"class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
"type": "sink",
"version": "5.5.1"
},
{
"class": "org.apache.kafka.connect.file.FileStreamSinkConnector",
"type": "sink",
"version": "2.5.0"
},
{
"class": "org.apache.kafka.connect.file.FileStreamSourceConnector",
"type": "source",
"version": "2.5.0"
},
{
"class": "org.apache.kafka.connect.mirror.MirrorCheckpointConnector",
"type": "source",
"version": "1"
},
{
"class": "org.apache.kafka.connect.mirror.MirrorHeartbeatConnector",
"type": "source",
"version": "1"
},
{
"class": "org.apache.kafka.connect.mirror.MirrorSourceConnector",
"type": "source",
"version": "1"
}
]
- twitter-connect-twitter (using Eneco/kafka-connect-twitter#53 to support the Kafka version)
- kafka-connect-twitter (github: https://github.com/jcustenborder/kafka-connect-twitter)
- kafka-connect-s3
- kafka-connect-elasticsearch
- Download zip and move
libstoplugins - Download guava-20.0.jar from https://github.com/google/guava/wiki/Release20 and put to
plugins
- Download zip and move