search

gjoseph92 / stackstac

Turn a STAC catalog into a dask-based xarray
https://stackstac.readthedocs.io
MIT License
248 stars 49 forks source link

WIP: Retries #232

Open gjoseph92 opened 11 months ago

gjoseph92 commented 11 months ago

Support retrying errors matching a given pattern.

This also moves error handling logic (both retires and nodata) up to the to_dask level, and out of Readers.

Closes #18.

charalamm commented 11 months ago

Hi @gjoseph92 thanks for this feature. I had a look an although I have not tested the code it looks good. The way of using this feature seems versatile so imho, nice, I would defiantly use this feature!

I see that you have not included the CPL_VSIL_CURL_NON_CACHED gdal parameter. Does the retry work without it or the users need to add in gdal_env?

Also, I would think that the possibility to add a delay between retries would be also useful.

charalamm commented 10 months ago

Hello @gjoseph92 . Do you think you will merge this anytime soon? Let me know if I can help somehow