New de-shuffle test (was "imagecodecs and hdf5plugin packages")

HDFGroup / hsds

Cloud-native, service based access to HDF data

https://www.hdfgroup.org/solutions/hdf-kita/

Apache License 2.0

128 stars 52 forks source link

New de-shuffle test (was "imagecodecs and hdf5plugin packages") #90

Closed ajelenak closed 2 years ago

ajelenak commented 3 years ago

Added these two Python packages with additional codecs. imagecodecs provides codecs used in many TIFF-based formats.

jreadey commented 3 years ago

Does this provide bitshuffle compression as well? i.e. fix for https://github.com/HDFGroup/hsds/issues/76 Beyond the dockerfile changes, I guess storUtil.py will need to be updated.

ajelenak commented 3 years ago

Yes, it should.

ajelenak commented 2 years ago

The main addition to this PR is a new de-shuffle test using an HDF5 file with known data. This required a fix to decouple detection of shuffle and compression filters. Several Python files had code reformatted for style or clarity. The main HSDS service Dockerfile was updated (and still includes the new compression packages as per original PR's intention).