Use zlib-ng - Githubissues

silx-kit / hdf5plugin

Set of compression filters for h5py

http://www.silx.org/doc/hdf5plugin/latest/

Other

65 stars 25 forks source link

Use zlib-ng #245

Open t20100 opened 1 year ago

t20100 commented 1 year ago

Following addition of blosc2 (PR #201), blosc2 and others are using zlib.

Yet, Blosc2 can use zlib-ng (sources included in internal-complibs/), and it should also be possible to use zlib-ng as a replacement for zlib for other filters too.

This is need to look at how zlib-ng handles building with SIMD instructions.

bnavigator commented 7 months ago

This already seems to be the case?

https://github.com/silx-kit/hdf5plugin/blob/2782806b8e1eb82f7b78dc2075296cf132a74a40/setup.py#L783 https://github.com/silx-kit/hdf5plugin/blob/2782806b8e1eb82f7b78dc2075296cf132a74a40/src/c-blosc2/internal-complibs/zlib-ng-2.0.7/README.md?plain=1#L1

t20100 commented 7 months ago

It'a currently using zlib (embedded in cblosc v1), not zlib-ng (embedded in cblosc v2).