yougov / mongo-connector

MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)
Apache License 2.0
1.88k stars 479 forks source link

Existing data replication #246

Closed slaniado closed 9 years ago

slaniado commented 9 years ago

Hi, the connector is working fine, but I realized that if the service of the connector fails and i enter new data in mongodb and i restart the service the already data is not sync, is there a option to tell the connector to sync the existing data?

llvtt commented 9 years ago

Usually, mongo connector syncs only new data, based on the timestamp file (usually called "oplog.timestamp"). If you delete this file or use a new one, mongo-connector will sync everything from the beginning. See https://github.com/10gen-labs/mongo-connector/wiki/Oplog-Progress-File#collection-dumps-and-the-oplog-progress-file.

On 05/06/2015 06:25 PM, Saul Laniado wrote:

Hi, the connector is working fine, but I realized that if the service of the connector fails and i enter new data in mongodb and i restart the service the already data is not sync, is there a option to tell the connector to sync the existing data?

— Reply to this email directly or view it on GitHub https://github.com/10gen-labs/mongo-connector/issues/246.

llvtt commented 9 years ago

I added this question to the FAQ. Closing this issue now; please feel free to reopen or create another issue if there's more to discuss.

slaniado commented 9 years ago

Thank you for your time

Enviado desde mi iPhone

El 01/06/2015, a las 13:35, Luke Lovett notifications@github.com escribió:

I added this question to the FAQ. Closing this issue now; please feel free to reopen or create another issue if there's more to discuss.

— Reply to this email directly or view it on GitHub.