search

awslabs / kinesis-kafka-connector

kinesis-kafka-connector is connector based on Kafka Connect to publish messages to Amazon Kinesis streams or Amazon Kinesis Firehose.
Apache License 2.0
153 stars 91 forks source link

org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches com.amazon.kinesis.kafka.AmazonKinesisSinkConnector #63

Open mdsufyan96 opened 3 years ago

mdsufyan96 commented 3 years ago

Hi, I get the below error while using this connector in MSK Connect and it just goes to Failed state. As you can see, it's able to find the connector class from the uploaded plugin jar as it lists it under available connectors but still throws class not found exception too.

Connector CloudWatch logs: org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches com.amazon.kinesis.kafka.AmazonKinesisSinkConnector available connectors are: PluginDesc{klass=class com.amazon.kinesis.kafka.AmazonKinesisSinkConnector, name='com.amazon.kinesis.kafka.AmazonKinesisSinkConnector', version='2.7.1', encodedVersion=2.7.1, type=sink, typeName='sink', location='file:KAFKA_DIR/plugins/kinesis-sink-plugin.zip_inflated/'}, PluginDesc{klass=class com.amazon.kinesis.kafka.FirehoseSinkConnector, name='com.amazon.kinesis.kafka.FirehoseSinkConnector', version='2.7.1', encodedVersion=2.7.1, type=sink, typeName='sink', location='file:KAFKA_DIR/plugins/kinesis-sink-plugin.zip_inflated/'}, ...

This is my connector class from connector configuration: connector.class=com.amazon.kinesis.kafka.AmazonKinesisSinkConnector

Has anyone faced similar issues while creating one in MSK connect ? btw, this works fine running in local box with plugins,path appended properly.

Thanks, Sufyan

bdesert commented 3 years ago

are you using console to create the connector? if so, please provide the configuration (copy-paste please) and let me know also your host machine - is that linux/win/mac system?

bdesert commented 2 years ago

Please comment if this is still an issue. if yes, please take a look at: https://github.com/awslabs/kinesis-kafka-connector/issues/64

It seems like when you copy/paste from a browser on windows-based machine, you are copying the \r EOL, which is not recognized later by the property parser in MSK Connect. please ensure you have proper \n instead.