search

Blosc / bcolz

A columnar data container that can be compressed.
http://bcolz.blosc.org
959 stars 149 forks source link

convert spark dataframe to bcolz and save #393

Open ghost opened 5 years ago

ghost commented 5 years ago

I have a spark dataframe and I want to convert this to some datatype that bcolz supports (ctable)? and I want to save this to disk, and load the same file from disk.

Is there any bcolz.read? I can't find a simple example for the situation I just discussed.