ICHEC struggles with I/O - and the reading/writing of config files for the QC tests is possibly the biggest problem, with a read/write for each variable for each test. JASMIN had no issue, hence this wasn't a problem until recently.
Update the qc_utils routines to handle these station qc configuration files to use a JSON file, which can be loaded on start up and then re-written at the end, giving a single I and single O step, and handled from memory inbetween.
ICHEC struggles with I/O - and the reading/writing of config files for the QC tests is possibly the biggest problem, with a read/write for each variable for each test. JASMIN had no issue, hence this wasn't a problem until recently.
Update the
qc_utilsroutines to handle these station qc configuration files to use a JSON file, which can be loaded on start up and then re-written at the end, giving a single I and single O step, and handled from memory inbetween.