confluentinc / cp-docker-images

[DEPRECATED] Docker images for Confluent Platform.
Apache License 2.0
1.14k stars 705 forks source link

Replicator tutorial fails because io.confluent.connect.replicator.ReplicatorSourceConnector is missing. #896

Closed hp598 closed 3 years ago

hp598 commented 3 years ago

Hi,

Adding a new replicator configuration fails even though replicator seems to find that class during startup: [main] INFO org.apache.kafka.common.utils.AppInfoParser - Kafka version: 5.5.3-ccs [main] INFO org.apache.kafka.common.utils.AppInfoParser - Kafka commitId: 4cb2620286ad0b06 [main] INFO org.apache.kafka.common.utils.AppInfoParser - Kafka startTimeMs: 1612533819923 [2021-02-05 14:03:48,007] INFO Added plugin 'io.confluent.connect.replicator.ReplicatorSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) [2021-02-05 14:04:18,304] INFO Added aliases 'ReplicatorSourceConnector' and 'ReplicatorSource' to plugin 'io.confluent.connect.replicator.ReplicatorSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader)

using that class in a replicator config fails though:

 curl localhost:8083/connectors -X POST -H "Content-Type: application/json" -d '@/home/replicator.json'
{"error_code":500,"message":"Failed to find any class that implements Connector and which name matches io.confluent.connect.replicator.ReplicatorSourceConnector, available connectors are: PluginDesc{klass=class com.couchbase.connect.kafka.CouchbaseSinkConnector, name='com.couchbase.connect.kafka.CouchbaseSinkConnector', version='3.2.2', encodedVersion=3.2.2, type=sink, typeName='sink', location='file:/var/run/connect/connectors/third-party/kafka-connect-couchbase/'}, PluginDesc{klass=class com.couchbase.connect.kafka.CouchbaseSourceConnector, name='com.couchbase.connect.kafka.CouchbaseSourceConnector', version='3.2.2', encodedVersion=3.2.2, type=source, typeName='source', location='file:/var/run/connect/connectors/third-party/kafka-connect-couchbase/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.azure.documentdb.sink.DocumentDbSinkConnector, name='com.datamountaineer.streamreactor.connect.azure.documentdb.sink.DocumentDbSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-azure-documentdb/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.blockchain.source.BlockchainSourceConnector, name='com.datamountaineer.streamreactor.connect.blockchain.source.BlockchainSourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-blockchain/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.bloomberg.BloombergSourceConnector, name='com.datamountaineer.streamreactor.connect.bloomberg.BloombergSourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-bloomberg/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.cassandra.sink.CassandraSinkConnector, name='com.datamountaineer.streamreactor.connect.cassandra.sink.CassandraSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-cassandra/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.cassandra.source.CassandraSourceConnector, name='com.datamountaineer.streamreactor.connect.cassandra.source.CassandraSourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-cassandra/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.coap.sink.CoapSinkConnector, name='com.datamountaineer.streamreactor.connect.coap.sink.CoapSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-coap/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.coap.source.CoapSourceConnector, name='com.datamountaineer.streamreactor.connect.coap.source.CoapSourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-coap/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.elastic6.ElasticSinkConnector, name='com.datamountaineer.streamreactor.connect.elastic6.ElasticSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-elastic6/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.elastic7.ElasticSinkConnector, name='com.datamountaineer.streamreactor.connect.elastic7.ElasticSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-elastic7/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.ftp.source.FtpSourceConnector, name='com.datamountaineer.streamreactor.connect.ftp.source.FtpSourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-ftp/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.hazelcast.sink.HazelCastSinkConnector, name='com.datamountaineer.streamreactor.connect.hazelcast.sink.HazelCastSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-hazelcast/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.hbase.HbaseSinkConnector, name='com.datamountaineer.streamreactor.connect.hbase.HbaseSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-hbase/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.influx.InfluxSinkConnector, name='com.datamountaineer.streamreactor.connect.influx.InfluxSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-influxdb/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.jms.sink.JMSSinkConnector, name='com.datamountaineer.streamreactor.connect.jms.sink.JMSSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-jms/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.jms.source.JMSSourceConnector, name='com.datamountaineer.streamreactor.connect.jms.source.JMSSourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-jms/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.kudu.sink.KuduSinkConnector, name='com.datamountaineer.streamreactor.connect.kudu.sink.KuduSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-kudu/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.mongodb.sink.MongoSinkConnector, name='com.datamountaineer.streamreactor.connect.mongodb.sink.MongoSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-mongodb/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.mqtt.sink.MqttSinkConnector, name='com.datamountaineer.streamreactor.connect.mqtt.sink.MqttSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-mqtt/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.mqtt.source.MqttSourceConnector, name='com.datamountaineer.streamreactor.connect.mqtt.source.MqttSourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-mqtt/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.pulsar.sink.PulsarSinkConnector, name='com.datamountaineer.streamreactor.connect.pulsar.sink.PulsarSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-pulsar/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.pulsar.source.PulsarSourceConnector, name='com.datamountaineer.streamreactor.connect.pulsar.source.PulsarSourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-pulsar/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.redis.sink.RedisSinkConnector, name='com.datamountaineer.streamreactor.connect.redis.sink.RedisSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-redis/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.rethink.sink.ReThinkSinkConnector, name='com.datamountaineer.streamreactor.connect.rethink.sink.ReThinkSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-rethink/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.rethink.source.ReThinkSourceConnector, name='com.datamountaineer.streamreactor.connect.rethink.source.ReThinkSourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-rethink/'}, PluginDesc{klass=class com.datamountaineer.streamreactor.connect.voltdb.VoltSinkConnector, name='com.datamountaineer.streamreactor.connect.voltdb.VoltSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-voltdb/'}, PluginDesc{klass=class com.eneco.trading.kafka.connect.twitter.TwitterSinkConnector, name='com.eneco.trading.kafka.connect.twitter.TwitterSinkConnector', version='', encodedVersion=, type=sink, typeName='sink', location='file:/var/run/connect/connectors/third-party/kafka-connect-twitter/'}, PluginDesc{klass=class com.eneco.trading.kafka.connect.twitter.TwitterSourceConnector, name='com.eneco.trading.kafka.connect.twitter.TwitterSourceConnector', version='', encodedVersion=, type=connector, typeName='connector', location='file:/var/run/connect/connectors/third-party/kafka-connect-twitter/'}, PluginDesc{klass=class com.landoop.streamreactor.connect.hive.sink.HiveSinkConnector, name='com.landoop.streamreactor.connect.hive.sink.HiveSinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-hive/'}, PluginDesc{klass=class com.landoop.streamreactor.connect.hive.source.HiveSourceConnector, name='com.landoop.streamreactor.connect.hive.source.HiveSourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-hive/'}, PluginDesc{klass=class com.splunk.kafka.connect.SplunkSinkConnector, name='com.splunk.kafka.connect.SplunkSinkConnector', version='v1.1.0', encodedVersion=v1.1.0, type=sink, typeName='sink', location='file:/var/run/connect/connectors/third-party/kafka-connect-splunk/'}, PluginDesc{klass=class io.confluent.connect.elasticsearch.ElasticsearchSinkConnector, name='io.confluent.connect.elasticsearch.ElasticsearchSinkConnector', version='5.5.1', encodedVersion=5.5.1, type=sink, typeName='sink', location='file:/var/run/connect/connectors/third-party/kafka-connect-elasticsearch/'}, PluginDesc{klass=class io.confluent.connect.hdfs.HdfsSinkConnector, name='io.confluent.connect.hdfs.HdfsSinkConnector', version='5.5.1', encodedVersion=5.5.1, type=sink, typeName='sink', location='file:/var/run/connect/connectors/third-party/kafka-connect-hdfs/'}, PluginDesc{klass=class io.confluent.connect.hdfs.tools.SchemaSourceConnector, name='io.confluent.connect.hdfs.tools.SchemaSourceConnector', version='2.5.1-L0', encodedVersion=2.5.1-L0, type=source, typeName='source', location='file:/var/run/connect/connectors/third-party/kafka-connect-hdfs/'}, PluginDesc{klass=class io.confluent.connect.jdbc.JdbcSinkConnector, name='io.confluent.connect.jdbc.JdbcSinkConnector', version='5.5.1', encodedVersion=5.5.1, type=sink, typeName='sink', location='file:/var/run/connect/connectors/third-party/kafka-connect-jdbc/'}, PluginDesc{klass=class io.confluent.connect.jdbc.JdbcSourceConnector, name='io.confluent.connect.jdbc.JdbcSourceConnector', version='5.5.1', encodedVersion=5.5.1, type=source, typeName='source', location='file:/var/run/connect/connectors/third-party/kafka-connect-jdbc/'}, PluginDesc{klass=class io.confluent.connect.s3.S3SinkConnector, name='io.confluent.connect.s3.S3SinkConnector', version='5.5.1', encodedVersion=5.5.1, type=sink, typeName='sink', location='file:/var/run/connect/connectors/third-party/kafka-connect-s3/'}, PluginDesc{klass=class io.confluent.connect.storage.tools.SchemaSourceConnector, name='io.confluent.connect.storage.tools.SchemaSourceConnector', version='2.5.1-L0', encodedVersion=2.5.1-L0, type=source, typeName='source', location='file:/var/run/connect/connectors/third-party/kafka-connect-s3/'}, PluginDesc{klass=class io.debezium.connector.mongodb.MongoDbConnector, name='io.debezium.connector.mongodb.MongoDbConnector', version='1.0.1.Final', encodedVersion=1.0.1.Final, type=source, typeName='source', location='file:/var/run/connect/connectors/third-party/kafka-connect-debezium-mongodb/'}, PluginDesc{klass=class io.debezium.connector.mysql.MySqlConnector, name='io.debezium.connector.mysql.MySqlConnector', version='1.0.1.Final', encodedVersion=1.0.1.Final, type=source, typeName='source', location='file:/var/run/connect/connectors/third-party/kafka-connect-debezium-mysql/'}, PluginDesc{klass=class io.debezium.connector.postgresql.PostgresConnector, name='io.debezium.connector.postgresql.PostgresConnector', version='1.0.1.Final', encodedVersion=1.0.1.Final, type=source, typeName='source', location='file:/var/run/connect/connectors/third-party/kafka-connect-debezium-postgres/'}, PluginDesc{klass=class io.debezium.connector.sqlserver.SqlServerConnector, name='io.debezium.connector.sqlserver.SqlServerConnector', version='1.0.1.Final', encodedVersion=1.0.1.Final, type=source, typeName='source', location='file:/var/run/connect/connectors/third-party/kafka-connect-debezium-sqlserver/'}, PluginDesc{klass=class io.lenses.streamreactor.connect.aws.s3.sink.S3SinkConnector, name='io.lenses.streamreactor.connect.aws.s3.sink.S3SinkConnector', version='2.1.3', encodedVersion=2.1.3, type=sink, typeName='sink', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-aws-s3/'}, PluginDesc{klass=class io.lenses.streamreactor.connect.aws.s3.source.S3SourceConnector, name='io.lenses.streamreactor.connect.aws.s3.source.S3SourceConnector', version='2.1.3', encodedVersion=2.1.3, type=source, typeName='source', location='file:/var/run/connect/connectors/stream-reactor/kafka-connect-aws-s3/'}, PluginDesc{klass=class org.apache.kafka.connect.file.FileStreamSinkConnector, name='org.apache.kafka.connect.file.FileStreamSinkConnector', version='2.5.1-L0', encodedVersion=2.5.1-L0, type=sink, typeName='sink', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.file.FileStreamSourceConnector, name='org.apache.kafka.connect.file.FileStreamSourceConnector', version='2.5.1-L0', encodedVersion=2.5.1-L0, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.mirror.MirrorCheckpointConnector, name='org.apache.kafka.connect.mirror.MirrorCheckpointConnector', version='1', encodedVersion=1, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.mirror.MirrorHeartbeatConnector, name='org.apache.kafka.connect.mirror.MirrorHeartbeatConnector', version='1', encodedVersion=1, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.mirror.MirrorSourceConnector, name='org.apache.kafka.connect.mirror.MirrorSourceConnector', version='1', encodedVersion=1, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.MockConnector, name='org.apache.kafka.connect.tools.MockConnector', version='2.5.1-L0', encodedVersion=2.5.1-L0, type=connector, typeName='connector', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.MockSinkConnector, name='org.apache.kafka.connect.tools.MockSinkConnector', version='2.5.1-L0', encodedVersion=2.5.1-L0, type=sink, typeName='sink', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.MockSourceConnector, name='org.apache.kafka.connect.tools.MockSourceConnector', version='2.5.1-L0', encodedVersion=2.5.1-L0, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.SchemaSourceConnector, name='org.apache.kafka.connect.tools.SchemaSourceConnector', version='2.5.1-L0', encodedVersion=2.5.1-L0, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.VerifiableSinkConnector, name='org.apache.kafka.connect.tools.VerifiableSinkConnector', version='2.5.1-L0', encodedVersion=2.5.1-L0, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.VerifiableSourceConnector, name='org.apache.kafka.connect.tools.VerifiableSourceConnector', version='2.5.1-L0', encodedVersion=2.5.1-L0, type=source, typeName='source', location='classpath'}"}

This happens in both confluentinc/cp-enterprise-replicator:6.0.1 and confluentinc/cp-enterprise-replicator:5.5.3 and with CONNECT_PLUGIN_PATH=/usr/share/java set.