feat(datasets): Improved compatibility, functionality and testing for SnowflakeTableDataset - Githubissues

kedro-org / kedro-plugins

First-party plugins maintained by the Kedro team.

Apache License 2.0

94 stars 90 forks source link

feat(datasets): Improved compatibility, functionality and testing for SnowflakeTableDataset #881

Closed tdhooghe closed 3 weeks ago

tdhooghe commented 1 month ago

Description

[x] Enable saving a Pandas DataFrame directly into a SnowflakeTable, i.e. to ingest a .csv directly into Snowflake within Kedro
[x] Update tests to use Snowpark's local testing framework
[x] Updated dependencies

Development notes

Skips pytest for Python version >3.11

Bump of cloudpickle required to allow for snowflake-snowpark-python >= 1.23

Checklist

[x] Opened this PR as a 'Draft Pull Request' if it is work-in-progress
[x] Updated the documentation to reflect the code changes
[x] Added a description of this change in the relevant RELEASE.md file
[x] Added tests to cover my changes