HDFGroup / hsds

Cloud-native, service based access to HDF data
https://www.hdfgroup.org/solutions/hdf-kita/
Apache License 2.0
128 stars 53 forks source link

Chunkinfo #230

Closed jreadey closed 1 year ago

jreadey commented 1 year ago

Added a new creationpropertylayout for a "chunk initializer" action. Curently the only supported action is "hsds-chunklocator". When set, HSDS will kick of a subprocess as each chunk in the dataset is first accessed. This process uses h5py to get chunklocations in the referenced HDF5 file and dataset.

See ValueTest.testChunkInitializer to see how this works.