Closed WentingWu666666 closed 3 years ago
TokenRangeAccumulator is an important feature to be able to resume from savepoints
DynamoDB migration is also a feature, so we cannot just comment it out :-)
for ssl support I just merged https://github.com/scylladb/scylla-migrator/pull/49 so this PR needs more work @WentingWu666666
while on the topic, even current version has some compatibility issues with cloud setups of clusters (private IPs) due to 4.x cassandra drivers in current spark connector supported the version before DynamoDB integration and connector upgrade seems to be the last stable for all clusters (but unfortunately for spark 2.4)
This PR makes scylla-migrator compatible with
spark-cassandra-connector-assembly 3.0.1
. Since there is noTokenRangeAccumulator
in the 3.0.1 spark connector, any related stuff is commented out.And it also fixes SSL support issue. The default SSL protocol in scylla is TLS. However, some Cassandra clusters are using TLSv1.2. So SSL protocol should be set when using scylla.