scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.
https://migrator.docs.scylladb.com/stable/
Apache License 2.0
61 stars 35 forks source link

initial dynamodb migrator #5

Closed tarzanek closed 5 years ago

iravid commented 5 years ago

🎉🎉!!

tarzanek commented 5 years ago

@iravid I will need to solve this joda-time exclusion in some better way - I'd rather exclude it from cassandra(which has older version) than from emr yet I didn't decide on solution (separate assemblies? different shading? get the cassandra connector binaries from nexus and exclude it from there?)

glommer commented 5 years ago

I am using my discretionary powers to merge this, even though I can't read scala =) It's unfortunate, but I tested this with Lubos and it at least works well.

@iravid obviously your post-merge comments are still very welcome and we can then fix whatever needs to be fixed.