search

HDFGroup / h5pyd

h5py distributed - Python client library for HDF Rest API
Other
109 stars 39 forks source link

support for multi-dim hyperchunking #176

Closed jreadey closed 3 months ago

jreadey commented 3 months ago

This update enables hyperchunking for hsload --link for HSDS version 0.9.0 and greater. For backlevel versions, ordinary 1-to-1 chunk mapping will be used.

mattjala commented 3 months ago

Does h5pyd currently have any tests that explicitly use hyperchunking?

jreadey commented 3 months ago

I'll update h5pyd/test/apps/config.py with some filenames that should invoke hyperchunking.

jreadey commented 3 months ago

I wasn't thinking - hyperchunking is only for hsload with --link. We should create some test for that as well, but it's a bit tricky.