search

HDFGroup / nasa_cloud

Apache License 2.0
3 stars 2 forks source link

Dynamically extract chunk locations #7

Closed jreadey closed 1 month ago

jreadey commented 1 year ago

For linked datasets, use h5py to query chunk locations and store results to be used as needed for future queries. Add option to hsload to not initialize chunk locations.

jreadey commented 1 year ago

chunk_iter requires hdf5 version 1.14.0 or higher and h5pyd 3.8.0 or higher.

jreadey commented 1 month ago

hsload now supports a --fastline option that has chunk locations exctracted server side.