benchmark in different computing environment

seung-lab / BigArrays.jl

Storing and accessing large Julia array locally or in cloud storage without server.

Apache License 2.0

13 stars 3 forks source link

benchmark in different computing environment #32

Open xiuliren opened 6 years ago

xiuliren commented 6 years ago

chunk size: 512x512x512, data is EM image chunk size is 256x256x32

task number is 20

xiuliren commented 6 years ago

the saving speed is much lower, probably due to zlib compression is slow. the compression speed is about 20-30 MB/s, which is comparable with the benchmark. My fork of Blosc.jl support multithreading compression and decompression, should be better to use. Since GoogleCloud.jl do not support customize compression, I can not use Blosc for now.