search

ArtesiaWater / hydropandas

Module for loading observation data into custom DataFrames
https://hydropandas.readthedocs.io
MIT License
52 stars 11 forks source link

Unknown Grondwaterstanden_Put Dino format #120

Closed martinvonk closed 1 year ago

martinvonk commented 1 year ago

Normally Grondwaterstanden_Put files look like this:

B46D0265003_1.csv

Titel:,,,,,,,,,,,
Gebruikersnaam:,,,,,,,,,,,
Periode aangevraagd:,01-01-1800,tot:,12-04-2023,,,,,,,,
Gegevens beschikbaar:,14-01-1987,tot:,28-12-1993,,,,,,,,
Datum: ,12-04-2023,,,,,,,,,,
Referentie:,NAP,,,,,,,,,,

NAP:,Normaal Amsterdams Peil,,,,,,,,,,
MV:,Maaiveld,,,,,,,,,,
MP:,Meetpunt,,,,,,,,,,

Locatie,Filternummer,Externe aanduiding,X-coordinaat,Y-coordinaat,Maaiveld (cm t.o.v. NAP),Datum maaiveld gemeten,Startdatum,Einddatum,Meetpunt (cm t.o.v. NAP),Meetpunt (cm t.o.v. MV),Bovenkant filter (cm t.o.v. NAP),Onderkant filter (cm t.o.v. NAP)
B46D0265,003,46DP0265,197320,411870,1578,01-04-1984,01-04-1984,14-01-1994,1578,,,

Locatie,Filternummer,Peildatum,Stand (cm t.o.v. MP),Stand (cm t.o.v. MV),Stand (cm t.o.v. NAP),Bijzonderheid,Opmerking,,,
B46D0265,003,14-01-1987,570,,1008,,,,,,
B46D0265,003,28-01-1987,561,,1017,,,,,,
B46D0265,003,14-02-1987,563,,1015,,,,,,
B46D0265,003,28-02-1987,564,,1014,,,,,,
B46D0265,003,14-03-1987,558,,1020,,,,,,
B46D0265,003,28-03-1987,544,,1034,,,,,,

But I found this as well...:

B46D0263001_0.csv

Titel: 
Gebruikersnaam: 
Periode aangevraagd: 01/01/1800-12/04/2023
Datum: 12/04/2023
Referentie: Maaiveld (MV)

LOCATIE,FILTERNUMMER,EXTERNE AANDUIDING,X-COORDINAAT,Y-COORDINAAT,MAAIVELD NAP,GESCHAT,MEETPUNT NAP,BOVENKANT FILTER,ONDERKANT FILTER,START DATUM,EIND DATUM
B46D0263,001,46DP0263,197350,411660,1524,,1524,824,624,1984/04/01,1994/01/14

LOCATIE,FILTERNUMMER,PEIL DATUM TIJD,STAND (MV),BIJZONDERHEID
B46D0263,001,1987/01/14 00:00:00,,
B46D0263,001,1987/01/28 00:00:00,,
B46D0263,001,1987/02/14 00:00:00,,
B46D0263,001,1987/02/28 00:00:00,,
OnnoEbbens commented 1 year ago

If you download a Dino zip file it will have a ..._0.csv and a ..._1.csv file for every measurement filter. I think we always use only the ..._1.csv and skip the others. Does that solve the issue?

martinvonk commented 1 year ago

:) probably

MattBrst commented 1 year ago

The ..._0.csv contains values relative to surface level. Most locations have an ..._1.csv file with measurements relative to reference level. Some old agricultural measurement points (the agricultural piezometers or in dutch: landbouwbuizen) may only have the first ones. In the old OLGA codes these contain the character L for landbouw.

martinvonk commented 1 year ago

Maybe we should raise an error if someone tries to read a _0.csv file? Because now you only get a KeyError for Startdatum which is not really informative?