search

aws-samples / aws-glue-samples

AWS Glue code samples
MIT No Attribution
1.44k stars 820 forks source link

Add example of Snowflake as a data sink with pre- and post-actions #91

Open gerrardcowburn opened 3 years ago

gerrardcowburn commented 3 years ago

Add GlueCustomConnectors\gluescripts\withConnection\spark-snowflake-example.py to demonstrate Snowflake database as a sink including pre and post actions

Issue #, if available: N/A

Description of changes: This script outlines how to Extract data from a Glue Catalog Data Source, Transform it, and Load it into a Snowflake database using the Snowflake Spark Connector and JDBC driver. It includes the ability to perform pre- and post-actions on the Snowflake database during the Load operation, including performing the pre-, load-, and post-action as a single database transaction

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.