ufs-community / ufs-weather-model

UFS Weather Model
Other
129 stars 238 forks source link

Inconsistent logging in rt.sh Rocoto mode #2207

Closed SamuelTrahanNOAA closed 1 month ago

SamuelTrahanNOAA commented 1 month ago

Description

The destinations of stderr and stdout are inconsistent between rt.sh modes.

  1. With ecFlow, stdout and stderr go to the compile*.log files, but with Rocoto only stdout goes there.
  2. Rocoto sends stderr to the test job log files, but not stdout (that file is empty).
  3. Rocoto combines the stdout and stderr streams of compiles into a .log file, but splits the test jobs into .err and (empty) .out files.

I suggest:

  1. Rocoto matches the ecFlow behavior and sends stdout and stderr together to compile*.log files.
  2. Rocoto sends both stderr and stdout to job log files.
  3. Rocoto combines stderr and stdout into one stream for job log files. This way, we don't lose the context of what errors go with what output. The separate out & err streams are in out & err files in the job's work directory if someone needs separate files.

To Reproduce:

Run rt.sh in Rocoto and ecFlow modes.