Put config values in spark-defaults.conf

trinodb / aws-proxy

Proxy for S3

Apache License 2.0

7 stars 3 forks source link

Put config values in spark-defaults.conf #135

Closed Randgalt closed 1 month ago

Randgalt commented 1 month ago

This better reflects how a Production Spark instance will run. Users will supply spark defaults that have our custom S3 client etc. in the Spark container. Spark Users shouldn't have to deal with this.