fluxnet / ONEFlux

Open Network-Enabled Flux processing pipeline
Other
79 stars 41 forks source link

Add option to continue product generation when one or more partitioning results not available #9

Open gilbertozp opened 2 years ago

gilbertozp commented 2 years ago

Need to add an execution parameter to skip the partitioning step or continue execution if it fails.

Parameters individually for each partitioning method are needed (e.g., skip NT only, or skip DT only, or skip all partitioning); important because DT is more susceptible to limitations, e.g., not enough data to finish optimization step. There are also situations where NT is not working (e.g. tropical sites where temperature is too stable).

The URE should run and create final outputs (99_fluxnet) with results even if one or more partitioning results are not generated.

Consider also time limits, so partitioning for sites that take too long can be interrupted; important, for instance, for sites for which it might be impossible to fit parameters or no sense (e.g. urban sites).

gilbertozp commented 1 year ago

Start with partitioning failures (NT/DT); can be an execution parameter to skip step.

For gapfilling and USTAR threshold estimates (especially urban ecosystems) can also be a problem, but can be done as a second step.