GeoscienceAustralia / ga_sar_workflow

InSAR processing workflow used by Geoscience Australia
Apache License 2.0
3 stars 1 forks source link

Refine process of building local environments #176

Closed truth-quark closed 3 years ago

truth-quark commented 3 years ago

The process of building a local runtime environment on Gadi is sub-optimal & needs repair.

Elements to consider:

This is related to the problem of multiple requirements files (#170).

mwheeler commented 3 years ago

Addendum to this, after multiple experiences w/ people trying to run this from InSAR team - we should also look at completely dropping the need for any kind of luigi.cfg

Any 'required' variables from there should have production-ready defaults (even our existing luigi.cfg doesn't have those), that aren't in a file but rather the default parameter values out-right (and some of those parameters shouldn't even be Luigi parameters, see: #213 - for things like multilook - which also confuses InSAR team who are used to / setting multilook in .proc files then having nightmares from the luigi value being used)

tl;dr - luigi.cfg shouldn't be required / we shouldn't be setting LUIGI_CONFIG_PATH at all