hellonarrativ / spectrify

Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.
https://aws.amazon.com/blogs/big-data/narrativ-is-helping-producers-monetize-their-digital-content-with-amazon-redshift/
MIT License
116 stars 25 forks source link

Add support for date type #18

Closed c-nichols closed 6 years ago

c-nichols commented 6 years ago

closes #15

andrewgross commented 6 years ago

Nice implementation, didn't know about ciso8601, will have to add that to my JSON lib. Any idea how date64 would work, or does it just use int64 instead of int32?

c-nichols commented 6 years ago

I assume it just uses 64-bit int. If that's the case, wouldn't be that hard to modify this implementation. That said -- Python date has a max year of 9999, so if you actually have dates far into the future this implementation will not work.