Open wildintellect opened 3 years ago
There are some tricks to getting faster reading of COG formatted files, many of these but not necessarily all could apply to ADE and DPS scripts reading COG files. https://github.com/developmentseed/titiler/blob/856b37924276b35c4ac33762dcef478fa75d6168/deployment/aws/cdk/config.py#L20-L28
The easiest one is (in Jupyter notebook syntax)
%env GDAL_DISABLE_READDIR_ON_OPEN=EMPTY_DIR
Need to figure out which ones are relevant, and how best to apply them. Might need to be per notebook/dps job since there may be times that users want/need to read side-car files.
There are some tricks to getting faster reading of COG formatted files, many of these but not necessarily all could apply to ADE and DPS scripts reading COG files. https://github.com/developmentseed/titiler/blob/856b37924276b35c4ac33762dcef478fa75d6168/deployment/aws/cdk/config.py#L20-L28
The easiest one is (in Jupyter notebook syntax)
Need to figure out which ones are relevant, and how best to apply them. Might need to be per notebook/dps job since there may be times that users want/need to read side-car files.