Perform load balancing when communicating with ScyllaDB Alternator

scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.

https://migrator.docs.scylladb.com/stable/

Apache License 2.0

61 stars 36 forks source link

Closed julienrf closed 3 months ago

julienrf commented 3 months ago

Fixes #117

We leverage https://github.com/scylladb/emr-dynamodb-connector/pull/3 to inject a transformer that uses the AlternatorEndpointProvider.

Based on #183.

tarzanek commented 3 months ago

I reviewed https://github.com/scylladb/scylla-migrator/pull/185/commits/1076c9ac9a3526c97861ca140554238e5dec835f and it makes sense and looks good, so I guess after rebase and seeing the tests pass we can merge this