search

awslabs / kinesis-kafka-connector

kinesis-kafka-connector is connector based on Kafka Connect to publish messages to Amazon Kinesis streams or Amazon Kinesis Firehose.
Apache License 2.0
153 stars 91 forks source link

[support]collect data from amazon msk to firehose #72

Open tingxin opened 2 years ago

tingxin commented 2 years ago

hi guys, i use kafka-kinesis-firehose-connector to create a connector in msk, but i met the issue:

ERROR [msk2Firehose2|task-1] WorkerSinkTask{id=msk2Firehose2-1} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:191)

could anyone give me some options to use it collect data from amazon msk to firehose!

thanks a lot

OneCricketeer commented 2 years ago

Can you share the complete stacktrace as well as your current configurations?

bdesert commented 2 years ago

this connector has been tested with MSK and works given proper configuration of endpoints in VPC and in connector's properties. please share the following: