search

blaze / castra

Partitioned storage system based on blosc. **No longer actively maintained.**
BSD 3-Clause "New" or "Revised" License
153 stars 21 forks source link

is_trivial_index branch doesn't handle more than two partitions #27

Closed cpcloud closed 9 years ago

cpcloud commented 9 years ago

When calling extend, we only add the length of the incoming chunk to the first partition which means pandas chunk reader doesn't just work with trivial indices

I wonder if this should be an option in core pandas.

cc @jreback

mrocklin commented 9 years ago

Whoops! Fixed

On Fri, Jul 24, 2015 at 5:18 PM, Phillip Cloud notifications@github.com wrote:

When calling extend, we only add the length of the incoming chunk to the first partition which means pandas chunk reader doesn't just work with trivial indices

I wonder if this should be an option in core pandas.

cc @jreback https://github.com/jreback

— Reply to this email directly or view it on GitHub https://github.com/Blosc/castra/issues/27.