zarr-developers / numcodecs

A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.
http://numcodecs.readthedocs.io
MIT License
121 stars 82 forks source link

Is Snappy algorithm available with Blosc? #495

Closed paumillet closed 6 months ago

paumillet commented 6 months ago

Hello there,

I was just wondering if Snappy algorithm was available again with Blosc compressor?

From what I've read, it was temporarily unavailable because of c-blosc upgrade in version 0.9.0. But it's currently written in last version (numcodecs 0.12.1) docs of Blosc that cname parameter is:

A string naming one of the compression algorithms available within blosc, e.g., ‘zstd’, ‘blosclz’, ‘lz4’, ‘lz4hc’, ‘zlib’ or ‘snappy’

Also, it seems like Snappy is made available with last versions of c-blosc.

Despite all this, I can't find Snappy algorithm in the list provided by

numcodecs.blosc.list_compressors()

['blosclz', 'lz4', 'lz4hc', 'zlib', 'zstd']

Is there a problem with my installation or is Snappy not available? If so, when will it be available again?

Thanks in advance for your answer!

mkitti commented 6 months ago

snappy is not currently included in https://github.com/Blosc/c-blosc/tree/main/internal-complibs which is where numcodecs would normally obtain the compression libs from.

paumillet commented 6 months ago

Ok, thanks for your reply!