search

coiled / dask-snowflake

Dask integration for Snowflake
BSD 3-Clause "New" or "Revised" License
29 stars 7 forks source link

Operate on Snowflake with already existing connection #26

Closed DamianBarabonkovQC closed 2 years ago

DamianBarabonkovQC commented 2 years ago

There are use-cases where operating on Snowflake using an already existing DB connection is necessary. One example is with temporary tables.

When creating a temporary table, the table only exists relative to and as long as the connection used to create it. With the current setup, which establishes a new connection on every dask-snowflake operation, this library will not be able to write to temporary tables. In this case, the original connection must be supplied to the library functions in order to work on the temporary table.

DamianBarabonkovQC commented 2 years ago

Also, the requirements of our project have changed that passing in a connection is no longer necessary. Is such a feature still desirable from your side, to allow for greater flexibility to the developer, or not?