scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra
Apache License 2.0
54 stars 34 forks source link

Savepoints are not supported for Alternator/DynamoDB #165

Open julienrf opened 1 week ago

julienrf commented 1 week ago

As mentioned in #164, savepoints are not currently supported for Alternator/DynamoDB. This means that if something goes wrong during a migration (e.g. an outage on the source database, Spark cluster, or target database), the migration will have to be restarted from zero, which can take a long time.

To implement it we would have to use an equivalent of CQL’s token ranges in DynamoDB.