search

scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.
https://migrator.docs.scylladb.com/stable/
Apache License 2.0
55 stars 34 forks source link

Add writetimeToleranceMillis config option #15

Closed goakley closed 4 years ago

goakley commented 4 years ago

In the case of double-writing from a piece of software, it's unlikely that writes will reach both databases at the exact same time. Adding a tolerance allows for the validator to be used in this situation.

glommer commented 4 years ago

Ack for the approach. @tarzanek can you take a look at the actual code please ?