search

opera-adt / disp-s1

OPERA Displacement workflows
Other
5 stars 8 forks source link

Add cloud-optimized HDF5 file creation options to `product.py` #47

Closed scottstanie closed 7 months ago

scottstanie commented 7 months ago

Full detail's pending results of Michael's test, but when creating the HDF5 files, we should

  1. switch to the "page" allocation strategy
  2. Set fs_page_size > max_data_chunk_size + epsilon, where max_data_chunk_size is the largest chunk for any dataset in the file. + epsilon could be replaced with * 2