kiyo-masui / bitshuffle

Filter for improving compression of typed binary data.
Other
215 stars 76 forks source link

Releasing the Python Global Interpreter Lock (GIL) during compression/decompression #100

Closed t20100 closed 3 years ago

t20100 commented 3 years ago

When using the Python package, it would be convenient for multi-threaded usage to release the Python Global Interpreter Lock (GIL), so one can run compression/decompression of different blocks in parallel using e.g., a ThreadPoolExecutor.