scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.
https://migrator.docs.scylladb.com/stable/
Apache License 2.0
55 stars 34 forks source link

partial table migration #44

Closed stoiev closed 3 years ago

stoiev commented 3 years ago

There are situations that migration can or need to be done partially.

On our specific case, we have some time series data that could be migrated using time frames (old and immutable data without service downtime, and hot data with service downtime).

But certainly there are more case, like garbage data that can be cleaned in migration.

tarzanek commented 3 years ago

lgtm, @stoiev I suppose you tested and used this code so I don't see any problem with it

tarzanek commented 3 years ago

merging, thank you @stoiev !