memsql / dbt-singlestore

Apache License 2.0
7 stars 8 forks source link

Implement connection close #17

Closed nikolasten closed 1 year ago

nikolasten commented 1 year ago

Kill running queries when cancelling job to not waist resources on singlestore cluster.

If we have the incremental job running periodically, and one of the queries takes too long to execute, we want to kill it when the dbt job times-out (by cancelling job). If this is not implemented and query is not killed, we can have multiple long running queries continuously added to cluster for execution on every incremental job run.

okramarenko commented 1 year ago

Hey @nikolasten!

Good news! We implemented the connection close logic you've asked for in our latest release -- 1.4.1

If you have any more questions or need further assistance, don't hesitate to reach out.

Take care and have a great day!