enram / data-repository

Data quality assessment
https://enram.github.io/data-repository/
MIT License
3 stars 1 forks source link

>200m elevation bins profiles are missing #52

Open ghost opened 5 years ago

ghost commented 5 years ago

Hello, I have noticed that there is no data available for frabb radar for the elevation bins above 200m for the end of Nov (24-30), Dec 2017, Jan 2018. I was wondering why these data are missing and is there a way for me to obtain them? Thank you

peterdesmet commented 5 years ago

Indeed, the data files are available, with data for elevations 0 and 200, but NA for all the rest. @adokter, any idea why higher elevations have no data?

library(bioRad)
vp <- bioRad::readvp("frabb_vp_20171201T0045Z_0x7.h5")
vp$data
    ff       dbz dens   u   v gap   w n_dbz  dd  n
1  NaN -14.82961    0 NaN NaN   1 NaN  1883 NaN 80
2  NaN -12.05624    0 NaN NaN   1 NaN    31 NaN  6
3   NA        NA   NA  NA  NA   1  NA     0  NA  0
4   NA        NA   NA  NA  NA   1  NA     0  NA  0
5   NA        NA   NA  NA  NA   1  NA     0  NA  0
6   NA        NA   NA  NA  NA   1  NA     0  NA  0
7   NA        NA   NA  NA  NA   1  NA     0  NA  0
8   NA        NA   NA  NA  NA   1  NA     0  NA  0
9   NA        NA   NA  NA  NA   1  NA     0  NA  0
10  NA        NA   NA  NA  NA   1  NA     0  NA  0
11  NA        NA   NA  NA  NA   1  NA     0  NA  0
12  NA        NA   NA  NA  NA   1  NA     0  NA  0
13  NA        NA   NA  NA  NA   1  NA     0  NA  0
14  NA        NA   NA  NA  NA   1  NA     0  NA  0
15  NA        NA   NA  NA  NA   1  NA     0  NA  0
16  NA        NA   NA  NA  NA   1  NA     0  NA  0
17  NA        NA   NA  NA  NA   1  NA     0  NA  0
18  NA        NA   NA  NA  NA   1  NA     0  NA  0
19  NA        NA   NA  NA  NA   1  NA     0  NA  0
20  NA        NA   NA  NA  NA   1  NA     0  NA  0
21  NA        NA   NA  NA  NA   1  NA     0  NA  0
22  NA        NA   NA  NA  NA   1  NA     0  NA  0
23  NA        NA   NA  NA  NA   1  NA     0  NA  0
24  NA        NA   NA  NA  NA   1  NA     0  NA  0
25  NA        NA   NA  NA  NA   1  NA     0  NA  0
       DBZH HGHT n_dbz_all      eta   sd_vvp n_all
1  26.70820    0      4847 11.85328 3.658018   697
2  30.53806  200      1984 22.44792 2.824990  1094
3        NA  400         0       NA       NA     0
4        NA  600         0       NA       NA     0
5        NA  800         0       NA       NA     0
6        NA 1000         0       NA       NA     0
7        NA 1200         0       NA       NA     0
8        NA 1400         0       NA       NA     0
9        NA 1600         0       NA       NA     0
10       NA 1800         0       NA       NA     0
11       NA 2000         0       NA       NA     0
12       NA 2200         0       NA       NA     0
13       NA 2400         0       NA       NA     0
14       NA 2600         0       NA       NA     0
15       NA 2800         0       NA       NA     0
16       NA 3000         0       NA       NA     0
17       NA 3200         0       NA       NA     0
18       NA 3400         0       NA       NA     0
19       NA 3600         0       NA       NA     0
20       NA 3800         0       NA       NA     0
21       NA 4000         0       NA       NA     0
22       NA 4200         0       NA       NA     0
23       NA 4400         0       NA       NA     0
24       NA 4600         0       NA       NA     0
25       NA 4800         0       NA       NA     0
ghost commented 5 years ago

I received reply from Meteo France. They have complete data (all elevation bins) in their archives for this time period, and I was advised to contact SMHI. Do you know whom I should address at SMHI? Thank you

peterdesmet commented 5 years ago

Issue regarding @apnest not getting access to the data is resolved. What remains is that the upper bins are cut off in the FR data on the repository. @adokter is that a processing or data input issue?

adokter commented 5 years ago

Regarding @apnest issue (Anna Nesterova), we have asked Gunther Haase at SMHI what might be the problem, he wrote on Sep 3 that he is looking into it. The problem has been fixed since Feb 12, but the data from Nov 24 2017 - Feb 12 2018 contain only data for the lowest elevations. This has likely been a problem at Baltrad, and the profiles will have to be reprocessed by someone.

Email to Gunther below for future reference:

I just noticed there are no profiles being generated for Finland since 12 February 2018 - does any of you know what may be the cause?

Probably related to this, the French profile data contain garbage from Nov 24 2017 - Feb 12 2018. I therefore suspect something was changed in the pipeline on Feb 12, which fixed a problem for France, but introduced a problem for Finland. Potentially this is related to the merging of scans into volumes at Baltrad.

Gunther/Liesbeth, any idea what is going on and whether there is an easy fix. Would be nice to have Finland running again with migration starting.

ghost commented 5 years ago

I am currently waiting for the raw data for frabb that Gunther Haase kindly agreed to send me. Once I have it, I will be happy to reprocess frabb data for Nov 24 2017 - Feb 12 2018 period.

peterdesmet commented 5 years ago

Nice, thanks!