search

scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.
https://migrator.docs.scylladb.com/stable/
Apache License 2.0
55 stars 34 forks source link

Parquet support and source abstraction #20

Closed iravid closed 4 years ago

iravid commented 4 years ago

This PR adds support for loading Parquet sources into ScyllaDB. It also rearranges the data types and configuration such that new sources can be added with relative ease.

Write targets will also be abstracted in a similar fashion in a follow-up.

tarzanek commented 4 years ago

thank you Itamar, looks good :-)