In https://github.com/coiled/dask-snowflake/pull/56 we added a pandas<2.2 restriction due to pandas=2.2 only supporting sqlalchemy>=2, but snowflake-sqlalchemy requiring sqlalchemy<2. This is unfortunate, but better than things breaking with the latest pandas release.
I noticed that we're only using snowflake-sqlalchemy to auto-create a table if it doesn't exist and snowflake-connector-python >= 2.7.3 has a auto_create_table= keyword for this exact functionality. This PR uses the built in auto_create_table=True in snowflake and removes our dependency on snowflake-sqlalchemy altogether. This also let's us drop the pandas<2.2 restriction.
In https://github.com/coiled/dask-snowflake/pull/56 we added a
pandas<2.2
restriction due topandas=2.2
only supportingsqlalchemy>=2
, butsnowflake-sqlalchemy
requiringsqlalchemy<2
. This is unfortunate, but better than things breaking with the latestpandas
release.I noticed that we're only using
snowflake-sqlalchemy
to auto-create a table if it doesn't exist andsnowflake-connector-python >= 2.7.3
has aauto_create_table=
keyword for this exact functionality. This PR uses the built inauto_create_table=True
in snowflake and removes our dependency onsnowflake-sqlalchemy
altogether. This also let's us drop thepandas<2.2
restriction.