search

seung-lab / ChunkFlow.jl

Distributed pipeline inside and beyond the cloud
Apache License 2.0
1 stars 0 forks source link

rescale affinitymap to 8 bit? #32

Closed xiuliren closed 6 years ago

xiuliren commented 7 years ago

affinitymap and semantic map is close to binary, but was formatted as Float32. In Phase II, this will cost about 24(3+4) = 56 peterbyte without compression! We got about 50% compression rate using blosclz, so it will still cost about 28 peterbyte storage!

at least for real time visualization, we can downsample and push 8-bit chunks to neuroglancer directly.

they could potentially be remapped to 8 bit to reduce the storage to 2*(3+4)= 14 without compression.

remapping

test effect of segmentation

xiuliren commented 6 years ago

affinitymap will be compressed with fpzip, which is much better than gzip.