outrauk / dataiku-plugin-snowflake-hdfs

DSS plugin for fast loading between Snowflake and HDFS
https://github.com/outrauk/dataiku-plugin-snowflake-hdfs
MIT License
0 stars 0 forks source link

Fix issue #5 by better handling types #6

Closed mklaber closed 4 years ago

mklaber commented 4 years ago

This PR fixes #5 by being more explicit in our schema types (rather than relying on Pandas/DSS to infer the time from a Dataframe). This is an issue that only seems to appear if the first row of the dataset has null values or values that would otherwise negatively influence the type inference.

This PR also adds a PyCharm build configuration for running unit tests.