blaze / castra

Partitioned storage system based on blosc. **No longer actively maintained.**
BSD 3-Clause "New" or "Revised" License
153 stars 21 forks source link

Pandas compat fix to deal with RangeIndex #55

Closed jcrist closed 8 years ago

jcrist commented 8 years ago

Pandas git master (will be 0.18.0 release, I believe) now uses RangeIndex objects for numerically increasing indices. In these cases, an Int64Index needs to be used for the partitions type. Tested and passes on both pandas 0.17.1 and pandas master.

mrocklin commented 8 years ago

This may affect dask.dataframe as well

jcrist commented 8 years ago

Yeah, loads of test failures running dask test suite on pandas master (from other changes). Those can be dealt with separately though. Or were you saying that creation of a dask dataframe from a castra might be affected? That still works fine.