Rijkswaterstaat / wm-ws-dl

wm-ws-dl documentation
https://rijkswaterstaatdata.nl/waterdata
11 stars 2 forks source link

unmasked outliers present in data for some stations #18

Open veenstrajelmer opened 6 months ago

veenstrajelmer commented 6 months ago

Outliers found in the getijverandering project (>100 or <-100), after filtering out all kwaliteitwaardecode=="99":

image

image

outliers_MSL_BRENTCLE.csv outliers_MSL_K14PFM.csv outliers_MSL_L9PFM.csv outliers_MSL_NORTHCMRT.csv

outliers_NAP_BROUWHVSGT02.csv outliers_NAP_BROUWHVSGT08.csv outliers_NAP_COLPT.csv outliers_NAP_HARVT10.csv outliers_NAP_HORSBGT.csv outliers_NAP_KATSBNN.csv outliers_NAP_NOORDVKBINV3.csv outliers_NAP_VLAKTVDRN.csv

TvLoon-RWS commented 4 months ago

This issue can be forwarded to the mainainers of the data source

KDoekes-RWS commented 4 months ago

The 51 incorrect values 99999952 with quality code 0 for BRENTCLE Brent Charlie have been replaced in DONAR by standard no-info values 999999999 with quality code 99. These are unvalidated data.

KDoekes-RWS commented 4 months ago

The 49 incorrect values 99999904 with quality code 0 for K14PFM K14 platform have been replaced in DONAR by standard no-info values 999999999 with quality code 99. These are unvalidated data.

KDoekes-RWS commented 4 months ago

The 53 incorrect values 99999904 with quality code 0 for L9PFM L9 platform have been replaced in DONAR by standard no-info values 999999999 with quality code 99. These are unvalidated data.

KDoekes-RWS commented 4 months ago

The 15 incorrect values 99999808 with quality code 0 for NORTHCMRT North Cormorant have been replaced in DONAR by standard no-info values 999999999 with quality code 99. These are unvalidated data.

KDoekes-RWS commented 4 months ago

The 11 incorrect very high or low values, all different, with quality code 0 for BROUWHVSGT02 Brouwershavensche Gat 02 have been replaced in DONAR by standard no-info values 999999999 with quality code 99. These are partly unvalidated data.

KDoekes-RWS commented 4 months ago

The water level data of BROUWGVSGT08 Brouwershavensche Gat 08 under Beherende Instantie RIKZITSDHG don't contain any extreme outlier. The water level data of BROUWHVSGT08 Brouwershavensche Gat 08 under Beherende Instantie ZLXXWVMMDBG contain 645 extreme outliers (one small series of 5 and one large series of 640), but I don't have write permission to change these in DONAR.

KDoekes-RWS commented 4 months ago

Also for COLPT Colijnsplaat holds that the data under Beherende Instantie RIKZITSDHG do not contain any extreme outlier. The outliers spotted are in data under Beherende Instantie ZLXXWVMMDBG which I cannot edit.

KDoekes-RWS commented 3 months ago

Also for Haringvliet 10 holds that the incorrect values are in a time series under Beherende Instantie ZLXXWVMMDBG, therefore I can't correct them in DONAR.

KDoekes-RWS commented 3 months ago

The three very high values for HORSBGT Horsborngat are in a time series under Beherende Instantie NNXXAWZV. I have no write permission to correct these data in DONAR.

KDoekes-RWS commented 3 months ago

The 42 incorrect values 23414 and 23415 for KATSBNN Kats binnen are in a time series under Beherende Instantie ZLXXWVMMDBG, for which I have no write permission.

KDoekes-RWS commented 3 months ago

The 13 incorrect values for NOORDVKBINV3 Noord Volkerak boei NV3 are in a time series under Beherende Instantie ZLXXWVMMDBG, for which I have no write permission.

KDoekes-RWS commented 3 months ago

The 10 incorrect values for VLAKTVDRN Vlakte van de Raan are in a time series under Beherende Instantie ZLXXWVMMDBG, for which I have no write permission.