databricks / spark-redshift

Redshift data source for Apache Spark
Apache License 2.0
605 stars 350 forks source link

Supporting region param in unload command #438

Open apoorva007 opened 5 years ago

apoorva007 commented 5 years ago

https://github.com/databricks/spark-redshift/blob/master/src/main/scala/com/databricks/spark/redshift/RedshiftRelation.scala#L96 - This suggests that we don't plan to support providing a region param to underlying redshift library although redshift now supports specifying a region for UNLOAD command (https://docs.aws.amazon.com/redshift/latest/dg/r_UNLOAD.html) I would like to submit a patch to support this. I am not too much familiar with the code base yet. Would like help from contributors on what is the best way to go forward with this