search

scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.
https://migrator.docs.scylladb.com/stable/
Apache License 2.0
58 stars 35 forks source link

Feature Request: Copy missing data shown in validation #100

Open Rumbles opened 1 year ago

Rumbles commented 1 year ago

I recently copied some large databases using this tool, it seems there was some issue in the process and the validator reports missing rows:

23/08/07 17:49:39 ERROR migrator: Found the following comparison failures:
23/08/07 17:49:39 ERROR migrator: 
Row failure:
* Source row: CassandraRow{user_id: ...}
* Target row: <MISSING>
* Failures:
  - Missing target row

Is it possible to add a feature so the validator can copy the missing data it detects?