search

EMCECS / ecs-sync

ecs-sync is a bulk copy utility that can move data between various systems in parallel
Apache License 2.0
61 stars 22 forks source link

FAQ question #12

Closed holgerjakob closed 7 years ago

holgerjakob commented 7 years ago

Hi all If I re-run a CAS to CAS job, will the query start back at epoch to now or is there a saved timestamp which will result in a query of timestamp to now? Thanks, Holger

twincitiesguy commented 7 years ago

It will start over. However, if you reuse the same database table to track the sync, it will skip over all of the clips that were already transferred. When using the UI, simply set a DB table name and reuse the same name in iterative syncs.

Note that it may take a while to catch up to where it was before if the migration includes millions of objects, but it is obviously much faster than remigrating everything.

holgerjakob commented 7 years ago

Hi Thanks a lot. A query in a large system may take ages, That's why I thought maybe the latest query point is saved. It would help in a cas source to be able to specify starting and endpoint of the query. This would then just add new clips to the database and migrate only the new ones without having to worry about an instable query. CU, Holger