Explore compressing intermediate files

wrgr commented 9 years ago

Should we zip fibers, tensors, etc? All together by scan? Or by pipeline step? Or each file individually?

Design decision might be that the overhead isn't worth it.

wrgr commented 9 years ago

what did we decide? I wanna know, plus let's document.

gkiar commented 9 years ago

aligned images are compressed
fibers are small so no need
graphs have the option to be compressed based on an input flag determined by the user.
no others leave the scratch space and are only used once therefore shouldn't be compressed as it just seems silly and unnecessary as they're about to be deleted anyways.

Greg Kiar gkiar07@gmail.com

On Mon, Oct 5, 2015 at 8:53 PM, William Gray notifications@github.com wrote:

what did we decide? I wanna know, plus let's document.

— Reply to this email directly or view it on GitHub https://github.com/openconnectome/m2g/issues/119#issuecomment-145712213.

wrgr commented 9 years ago

Great. Thank you!

neurodata / ndgrutedb

Explore compressing intermediate files #119