OneArgo / ArgoVocabs

A repository for the management of issues related to vocabularies managed by the Argo Data Management Team
8 stars 0 forks source link

Map Argo QC flags to Qartod QC flags #143

Open tcarval opened 4 days ago

tcarval commented 4 days ago

Argo QC flags are documented in RR2 and RD2 reference tables. Qartoq QC flags scale is documented in http://dx.doi.org/10.25923/w8y6-d298

RR2 and RD2 Argo QC flags should be mapped to Qartod QC flag.

Here is the mapping proposal

<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns="http://www.w3.org/TR/REC-html40">

n | Meaning | Real-time comment | Delayed-mode comment | qartod flag | qartod meaning -- | -- | -- | -- | -- | -- 0 | No QC is performed | No QC is performed. | No QC is performed. | 2 | Not evaluated 1 | Good data | Good data. All Argo real-time QC tests passed. These measurements are good within the limits of the Argo real-time QC tests. | Good data. No adjustment is needed, or the adjusted value is statistically consistent with good quality reference data. An error estimate is supplied. | 1 | Pass 2 | Probably good data | Probably good data. These measurements are to be used with caution. | Probably good data. Delayed-mode evaluation is based on insufficient information. An error estimate is supplied. | 3 | Suspect or Of High Interest 3 | Probably bad data that are potentially adjustable | Probably bad data. These measurements are not to be used without scientific adjustment, e.g. data affected by sensor drift but may be adjusted in delayed-mode. | Probably bad data. An adjustment may (or may not) have been applied, but the value may still be bad. An error estimate is supplied. | 3 | Suspect or Of High Interest 4 | Bad data | Bad data. These measurements are not to be used. A flag '4' indicates that a relevant real-time qc test has failed. A flag '4' may also be assigned for bad measurements that are known to be not adjustable, e.g. due to sensor failure. | Bad data. Not adjustable. Adjusted data are replaced by FillValue. | 4 | Fail 5 | Value changed | Value changed | Value changed | 1 | Pass 6 | Not used | Not used | Not used | - | - 7 | Not used | Not used | Not used | - | - 8 | Estimated value | Estimated value (interpolated, extrapolated or other estimation). | Estimated value (interpolated, extrapolated or other estimation). | 1 | Pass 9 | Missing value | Missing value. Data parameter will record FillValue. | Missing value. Data parameter will record FillValue. | 9 | Missing data ‘ ‘ | FillValue | Empty space in NetCDF file. | Empty space in NetCDF file. | - | -

tcarval commented 3 days ago

@danibodc is the Qartod QC flag scale available on NVS ? If yes, it will be easy to perform the mapping.

tcarval commented 3 days ago

@CandiceAOML , would you agree to check the Argo-Qartod QC flags mapping ?

CandiceAOML commented 3 days ago

@CandiceAOML , would you agree to check the Argo-Qartod QC flags mapping ?

@tcarval Sure! I'll share with the AOML DAC and we'll respond asap. Thanks!

danibodc commented 3 days ago

@tcarval there is an entry in the L27 collection 'SeaVoX data quality control flagging conventions' defining Qartod flags as a type of flagging convention, but the individual flags themselves aren't defined anywhere on the NVS as far as I can tell. So a new collection would be needed.

https://vocab.nerc.ac.uk/collection/L27/current/QARTOD_QC/