enram / data-repository

Data quality assessment
https://enram.github.io/data-repository/
MIT License
3 stars 1 forks source link

Include quantities in BALTRAD summary? #83

Closed peterdesmet closed 1 year ago

peterdesmet commented 4 years ago

The BALTRAD file listing (see enram/globam-dmp#15) also contains information on the quantities that are included. Günther (by email):

Some filenames contain a hex-string which corresponds to the quantities included in the file. If you want to use this information you need a hex-to-binary converter and the attached xml-table. No hex-string usually means both DBZH and VRADH are available.

odim_quantities.txt

I'm not sure I've found hex codes yet, but some file names are indeed longer:

sklaz_pvol_20161109T1430Z_0x4_147870277014.h5
nosmn_pvol_20161109T1430Z_0x1.h5
fipet_pvol_20161109T1430Z_0x7.h5
silis_pvol_20161109T1430Z_0x7_147870308505.h5

Or for the same radar:

behel_pvol_20180226T125003Z.h5
behel_pvol_20180226T125003Z_0x1.h5
behel_pvol_20180226T125003Z_0x1_15196497864.h5
behel_pvol_20180226T125003Z_0x2.h5
behel_pvol_20180226T125003Z_0x2_151964975286.h5

@CeciliaNilsson709 do we want this type of information?

CeciliaNilsson709 commented 4 years ago

Yes, I think this will be useful information when figuring out why some countries are not working properly.

peterdesmet commented 4 years ago

Here's already a summary of all the - what I assume - hex values in the file names and how often they occur:

   hex          n
   <chr>    <int>
 1 0x1    6569804
 2 0x2    2105329
 3 0x3    1483978
 4 0x4    2786755
 5 0x5     397350
 6 0x6          8
 7 0x7    3340281
 8 0x8    2607779
 9 0x9     168008
10 NA    32672189
adokter commented 4 years ago

If I remember correctly this has something to do with the merging and postprocessing that happens at baltrad, including the merging of various scans into polar volumes. So all the original files coming in from opera are present, as well as the merged files, which might get a postfix. Would be a matter of looking at what is inside these files to understand what's happening exactly.

peterdesmet commented 1 year ago

Closing due to inactivity.