move-coop / parsons

A python library of connectors for the progressive community.
https://www.parsonsproject.org/
Other
258 stars 128 forks source link

Enable use of "extension" argument to Redshift unload #871

Closed austinweisgrau closed 11 months ago

austinweisgrau commented 1 year ago

Extension is a helpful argument. This PR makes it possible to use the extension argument on Redshift.unload()

I have a workflow where I unload SQL query to S3, and then make the resulting file available to download. It's great if that file already has a proper extension and I don't need to rename the file in S3 first. Currently all Redshift.unload() files have an extension of .gz if the file is compressed or simply ends with 000 if not.