search

DataReply / kafka-connect-mongodb

Apache License 2.0
129 stars 61 forks source link

Loss of records in the insertion in mongo #16

Open JessicaMatiasBlancas opened 7 years ago

JessicaMatiasBlancas commented 7 years ago

Hi I use mongo sink connector in distributed mode. I send registers from my producer to mongo database, but I'm lost 70% of registers In my mongo database only are 30%

This is the configuration of my connector curl -X POST -H "Content-Type: application/json" --data '{"name":"test-sink-mongo","config":{"connector.class":"org.apache.kafka.connect.mongodb.MongodbSinkConnector","tasks.max":"1","host":"10.0.0.25","port":"27017","bulk.size":"100","mongodb.database":"test","mongodb.collections":"collection-database-example","topics":"MONGO"}}' http://localhost:8083/connectors

anupkumarsharma commented 6 years ago

Its hard to debug without seeing the setup. The best way is to add a log statement in put() and check if you are getting all the events. If not, you might have to check the kafka connect setup.