apache / rocketmq-connect

A tool for scalable and reliably streaming data between Apache RocketMQ and other systems.
https://rocketmq.apache.org/
Apache License 2.0
121 stars 117 forks source link

How can i migrant from kafka to rocketmq? #527

Open pc-gh opened 10 months ago

pc-gh commented 10 months ago

There are my steps:

It can work normal,console show the message "The standalone worker boot success.".

i set plugin path value as your recommand

pluginPaths=/usr/local/connector-plugins

I try to package the module "rocketmq-connect-kafka",but i got a pom file.then i change pom.xml,let packaging labe value equal jar,then i got a jar file.And i push it to the plugin path.i also restarted Worker by the script "sh bin/connectshutdown.sh".

I create connect kafka by url like this:

http://127.0.0.1:8081/connectors/connector-name?config={"connector.class":"org.apache.rocketmq.connect.kafka.connector.KafkaSourceConnector","tasks.num":"1","kafka.topics":"test1,test2","kafka.group.id":"group0","kafka.bootstrap.server":"127.0.0.1:9092","source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}

however i got the response:

{
    "errorCode": 500,
    "message": "Failed to find any class that implements Connector and which name matches org.apache.rocketmq.connect.kafka.connector.KafkaSourceConnector, available connectors are: PluginWrapper{klass=class org.apache.rocketmq.connect.file.FileSinkConnector, name='org.apache.rocketmq.connect.file.FileSinkConnector', type=sink, typeName='sink', location='classpath', version='undefined', encodedVersion=undefined, classLoader=sun.misc.Launcher$ExtClassLoader@19469ea2}, PluginWrapper{klass=class org.apache.rocketmq.connect.file.FileSourceConnector, name='org.apache.rocketmq.connect.file.FileSourceConnector', type=source, typeName='source', location='classpath', version='undefined', encodedVersion=undefined, classLoader=sun.misc.Launcher$ExtClassLoader@19469ea2}"
}

Did i overlook something important?Hope your reply!

zhongxig commented 10 months ago
  1. Explain: "Failed to find": means "connector-plugins" didn't contains "org.apache.rocketmq.connect.kafka.connector.KafkaSourceConnector" plugin-jar.
  2. Cause: maybe "3、add connect-kafka plugin" has something error. let me see.