Support s3a protocol to read Parquet files

scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra

Apache License 2.0

54 stars 34 forks source link

Closed julienrf closed 2 weeks ago

julienrf commented 2 weeks ago

Add hadoop-aws to the classpath to provide out-of-the-box support for reading Parquet files from S3 via s3a (or s3n) URIs

Tested on my machine with my own AWS S3 bucket

Based on #151

julienrf commented 2 weeks ago

Superseded by #155