search

getindata / kedro-snowflake

Kedro Snowflake / Snowpark plugin
https://kedro-snowflake.readthedocs.io/
Apache License 2.0
13 stars 2 forks source link

Add cleanup step to drop all sprocs/tasks related to a specific pipeline #3

Open mwiewior opened 1 year ago

mwiewior commented 1 year ago

If we remove a node from a kedro pipeline the corresponding Snowflake task is not dropped. The idea is to drop all tasks related to a given pipeline/root node prior to fresh deployment.

Lasica commented 1 year ago

Also encountered this, had to manually suspend one task that was blocking execution.