astronomer / astro-sdk

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
https://astro-sdk-python.rtfd.io/
Apache License 2.0
350 stars 43 forks source link

Clean up the tables for all databases #1686

Open sunank200 opened 1 year ago

sunank200 commented 1 year ago

Describe the bug Seems like the clean-up is not working properly for all databases as aspected. There are many tables which are there in databases. We should check the reason for this and fix this.

We should have a clean-up script as part of GitHub actions or a script which runs with some cadence.

sunank200 commented 1 year ago

For snowflake - following is the issue: https://github.com/astronomer/astro-sdk/issues/1663