In https://github.com/coiled/dask-snowflake/pull/56 we added a pandas<2.2 restriction due to pandas=2.2 only supporting sqlalchemy>=2, but snowflake-sqlalchemy requiring sqlalchemy<2. This is unfortunate, but better than things breaking with the latest pandas release.
I noticed that we're only using snowflake-sqlalchemy to auto-create a table if it doesn't exist and snowflake-connector-python >= 2.7.3 has a auto_create_table= keyword for this exact functionality. This PR uses the built in auto_create_table=True in snowflake and removes our dependency on snowflake-sqlalchemy altogether. This also let's us drop the pandas<2.2 restriction.
In https://github.com/coiled/dask-snowflake/pull/56 we added a
pandas<2.2restriction due topandas=2.2only supportingsqlalchemy>=2, butsnowflake-sqlalchemyrequiringsqlalchemy<2. This is unfortunate, but better than things breaking with the latestpandasrelease.I noticed that we're only using
snowflake-sqlalchemyto auto-create a table if it doesn't exist andsnowflake-connector-python >= 2.7.3has aauto_create_table=keyword for this exact functionality. This PR uses the built inauto_create_table=Truein snowflake and removes our dependency onsnowflake-sqlalchemyaltogether. This also let's us drop thepandas<2.2restriction.