kiyo-masui / bitshuffle

Filter for improving compression of typed binary data.
Other
215 stars 76 forks source link

Lock free decompression #139

Open jonwright opened 1 year ago

jonwright commented 1 year ago

As mentioned in issue #138, you can get a speed up for certain datasets on large CPU's by using a static openmp schedule. In this pull request, all threads read all offsets to find the compressed data and output pointers are computed.

Depending on whether load balancing is needed by other people, it might be better to use schedule(runtime) instead of schedule(static).