scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.
https://migrator.docs.scylladb.com/stable/
Apache License 2.0
61 stars 36 forks source link

fails to copy row_keys table because non-nullable field data_type of the Cassandra DB contains null values #85

Open tarzanek opened 2 years ago

tarzanek commented 2 years ago

migrate from Cassandra 3.11.13 to ScyllaDB, the schema is from KairosDB, migrator fails to copy row_keys table because non-nullable field data_type of the Cassandra DB contains null values (error: RuntimeException: The 3th field 'data_type' of input row cannot be null)

is there a workaround?

tarzanek commented 2 years ago

generally we can add a null check into preparation of the data for writing, but it is weird a non-nullable column contains nulls does Cassandra have some way to either repair or scrub the data? (ala https://docs.scylladb.com/stable/operating-scylla/nodetool-commands/scrub.html )