Applied-GeoSolutions / gips

Geospatial Image Processing System
GNU General Public License v3.0
17 stars 5 forks source link

if a fetch fails it should still archive before the process exits #416

Open ra-tolson opened 7 years ago

ra-tolson commented 7 years ago

For sentinel-2 it was observed that a fetch failure or breakage for a specific scene results in a failure to archive whatever might've built up in stage/ during previous fetches of previous scenes for that run. That results in a long-term cluttering of the stage, first of all, and secondly a failure to archive perfectly good data.

Make it always archive staged files before existing, even if there's a fetch failure (do this for all of gips, not just sentinel2).