The run_qc_checks.bash uses the same job settings (memory and runtime) for all stations (bar the US ones, which are given twice the time). There will be a link between the size of the file on disc (~ number of observations) and the time & memory the internal QC processes take/need to run. Investigate this to see whether there are some easy relationships that could be used to tune the job requirements to the file in run_qc_checks.bash.
The
run_qc_checks.bashuses the same job settings (memory and runtime) for all stations (bar the US ones, which are given twice the time). There will be a link between the size of the file on disc (~ number of observations) and the time & memory the internal QC processes take/need to run. Investigate this to see whether there are some easy relationships that could be used to tune the job requirements to the file inrun_qc_checks.bash.