Added S3 and RedShift COPY commands

bcgov / GDX-Analytics

GDX-Analytics working space: microservices, tests, POCs, and other scripts

Apache License 2.0

10 stars 3 forks source link

Closed lclarko closed 3 years ago

lclarko commented 3 years ago

This commit adds several actions:

It writes the output of the script to S3
Issues a COPY command to RedShift
Moves the output of the script on S3 to a processed folder
The RedShift queries in the script have been modified to allow for more SQL like formatting