scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.
https://migrator.docs.scylladb.com/stable/
Apache License 2.0
55 stars 34 forks source link

[RFC] Allow for configurable path for savepoints #19

Open gnumoreno opened 4 years ago

gnumoreno commented 4 years ago

It would be good to write "savepoint" parameter in HDFS of the Cluster.

For example:

savepoints: path: hdfs://...

Is it possible to create any flag to choose if I want to write my "savepoint" in local path or in HDFS?

choose the flag parameter "local" or "hdfs"

flag=

albertjosearaujo commented 3 years ago

Enhancement related to original ZD record # 1276