scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.
https://migrator.docs.scylladb.com/stable/
Apache License 2.0
61 stars 36 forks source link

Add tests that access AWS #208

Closed julienrf closed 2 months ago

julienrf commented 2 months ago

Alternative to #205. Fixes #113.

The first commit (4945055) is taken from #205.

The second commit (127429d) changes the authentication workflow to rely on GitHub as an OpenID Connect provider (instead of using AssumeRole with static AWS credentials, which can not expose in the CI, even as GitHub secrets), and removes the AssumeRole authentication test.

The remaining commits fix issues that I discovered while working on this, and could be extracted out to separate PRs if needed: