Add retry and timeout options for ISH reader

noaa-oar-arl / monetio

The Model and ObservatioN Evaluation Tool I/O package

https://monetio.readthedocs.io

MIT License

17 stars 30 forks source link

Add retry and timeout options for ISH reader #157

Closed zmoon closed 9 months ago

zmoon commented 10 months ago

and also address a few warnings.

Default timeout is 10 (like it was set to before), but now, by default, 4 retries will be made, for a total of 5 tries. And both timeout and retries can be set from add_data.

cc: @jordanschnell

xref: NOAA-CSL/MELODIES-MONET#232

zmoon commented 10 months ago

Retries shouldn't be needed after moving to AWS (#113), but we might set it up so using AWS would be optional.

zmoon commented 10 months ago

As noted here, a historical case with full-length files did succeed, though took > 2 hours.