confluentinc / cp-docker-images

[DEPRECATED] Docker images for Confluent Platform.
Apache License 2.0
1.14k stars 703 forks source link

missing connector libraries in cp-kafka-connect docker image #891

Open electriquo opened 3 years ago

electriquo commented 3 years ago

using cp-kafka-connect version 5.5.2 i successful set connectors (s3, elasticsearch, etc.). after upgrading to version 6.0.1, when i try to enable the connectors, i get the following error

Failed to find any class that implements Connector and which name matches io.confluent.connect.elasticsearch.ElasticsearchSinkConnector, available connectors are ...

digging into the containers of each of which, it seems that some connect libraries are missing from /usr/share/java/kafka-connect-*

$ docker run --rm -it confluentinc/cp-kafka-connect:5.5.2 \
    /bin/bash -c 'ls -x1 -d /usr/share/java/kafka-connect-*'
/usr/share/java/kafka-connect-activemq
/usr/share/java/kafka-connect-elasticsearch
/usr/share/java/kafka-connect-ibmmq
/usr/share/java/kafka-connect-jdbc
/usr/share/java/kafka-connect-jms
/usr/share/java/kafka-connect-s3
/usr/share/java/kafka-connect-storage-common

$ docker run --rm -it confluentinc/cp-kafka-connect:6.0.1 \
    /bin/bash -c 'ls -x1 -d /usr/share/java/kafka-connect-*'
ls: cannot access '/usr/share/java/kafka-connect-*': No such file or directory
  1. it this intended?
  2. what is the shortest path to upgrade to version 6.0.1?
electriquo commented 3 years ago

just saw the deprecation notice.

still trying to figure out how to upgrade to latest s3 connect docker image

electriquo commented 3 years ago

downloaded the plugins of s3 and elasticsearch, then followed installing kafka connect plugins