GeoscienceAustralia / ga_sar_workflow

InSAR processing workflow used by Geoscience Australia
Apache License 2.0
3 stars 0 forks source link

Improving ard.py error handling #366

Open truth-quark opened 2 years ago

truth-quark commented 2 years ago

The insar/workflow/luigi/ard.py module can break in certain circumstances when adding support for new sensors.

If the metadata/the file paths don't match, such as the file paths, ard.py breaks here: https://github.com/GeoscienceAustralia/gamma_insar/blob/pygamma_workflow/insar/workflow/luigi/ard.py#L203

Also, ard.py can break if --src-file is used the data dirs are moved somewhere else. The stack expects old dirs, and even though new dirs are identical data, the code assumes dates are removed because the paths don't match.

A fix includes: