search

HDFGroup / hsds

Cloud-native, service based access to HDF data
https://www.hdfgroup.org/solutions/hdf-kita/
Apache License 2.0
129 stars 53 forks source link

"Edge Chunk" issues. #9

Closed jreadey closed 5 years ago

jreadey commented 6 years ago

Re this conversation from https://github.com/zarr-developers/zarr/issues/233#issuecomment-365934396 on using full size chunks along edges vs. using smaller chunks.

HSDS is using smaller chunks but we are not resizing the chunks during resize operations either.

Need to create test case to demonstrate the bug and figure out how to address.

jreadey commented 5 years ago

The above is incorrect - HSDS is using "full size" chunks along the edges. The results in some wasted storage for some cases when compression is not used, but greatly reduces the complexity of the code.