wmo-im / BUFR4

BUFR edition 4
MIT License
27 stars 9 forks source link

Table D, new BUFR Template for representation of UAS #163

Closed marijanacrepulja closed 11 months ago

marijanacrepulja commented 1 year ago

Initial request

New BUFR template is develop to represent observations from UAS (Uncrewed Aircraft Systems). That is in support to UAS campaign and in collaboration with WMO TT-UAS.

Amendment details

3 11 013 Uncrewed Aircraft Systems Note
301150 WIGOS station id
001008 Aircraft/platform identifier
001095 Observation identification
301011 YEAR, MONTH, DAY
301013 HOUR,MINUTE, SECOND
301021 Latitude/longitude (high accuracy)
001013 Speed of motion of moving observing platform
008009 Detailed phase of flight
007010 Flight Level
033003 Quality information
011001 Wind direction
011002 Wind speed
012101 Temperature/ air temperature
002170 Aircraft humidity sensor
201144 Change data width
202133 Change scale
013002 Mixing ratio
202000 Change scale Cancel
201000 Change data width Cancel
201135 Change data width
202130 Change scale
013003 Relative humidity
202000 Change scale Cancel
201000 Change data width Cancel
011073 Turbulent kinetic energy
011075 Mean turbulence intensity (eddy dissipation rate)

Comments

No response

Requestor(s)

Alexander Cresst (DWD), Marijana Crepulja (ECMWF), Simon Elliot (EUMETSAT)

Stakeholder(s)

UAS community

https://community.wmo.int/en/uas-demonstration

Publication(s)

Example: Manual on Codes (WMO-No. 306), Volume I.2, BUFR table D

Expected impact of change

None

Collaborators

WMO TT-UAS

References

No response

Validation

No response

amilan17 commented 1 year ago

https://github.com/wmo-im/CCT/wiki/Teleconference.2&3May.2023 notes: Marijana presented proposal; Sibylle recommends using something more precise than 013002 from the AMDAR template and move WIGOSID to beginning of sequence (done); @SibylleK will validate, but is only available in July; @jbathegit will validate also;

SimonElliottEUM commented 1 year ago

@jbathegit @SibylleK @amilan17 I will also support some validation if you like

amilan17 commented 1 year ago

https://github.com/wmo-im/CCT/wiki/Teleconference.6.7.June.2023 notes: @marijanacrepulja still needs to create samples; still needs feedback on mixing ratio (013002);

SibylleK commented 1 year ago

@marijanacrepulja what kind of feedback you are waiting for?

My recommendation, more precisely was: In the AMDAR (version 7) template, i.e. sequence 311010 the mixing ratio and the relative humidity are used as follows:

FXY2 ElementName_en ElementDescription_en
201144 Change data width
202133 Change scale
013002 Mixing ratio
202000 Change scale Cancel
201000 Change data width Cancel
201135 Change data width
202130 Change scale
013003 Relative humidity
202000 Change scale Cancel
201000 Change data width Cancel

Wouldn't it be good to have the same precision in the UAS template, to be on the safe side?

marijanacrepulja commented 1 year ago

bufr_sample_UAS.tar.zip

@SibylleK, @jbathegit, @SimonElliottEUM Please find attached sample BUFR file and dump output of the UAS sample data. Thank you for your help.

@SibylleK I was waiting UAS sample data in netCDF and info about expected values for mixing ration. They advise that water vapor mixing ratio values range from close to zero to 50 g kg-1. I am happy to include the same precision in the UAS template as it is done for AMDAR. Therefore, I have updated proposal and branch accordingly. Thank you for your suggestion.

jbathegit commented 1 year ago

@marijanacrepulja it looks like the file you posted is a gzip file, not a zip file. I got errors when I tried to unzip it, but then on a whim I tried renaming it to .gz instead of .zip and then it worked with gunzip.

jbathegit commented 1 year ago

And with that I was able to successfully read and decode the 20230327030016_Lat_46.812245_Lon_6.944007.nc.new.bufr file. I didn't check all 349 data subsets, but the ones I did spot-check matched up to the values in your corresponding .txt file.

So I would consider this a successful validation of the new 3-11-013 sequence.

marijanacrepulja commented 1 year ago

@marijanacrepulja it looks like the file you posted is a gzip file, not a zip file. I got errors when I tried to unzip it, but then on a whim I tried renaming it to .gz instead of .zip and then it worked with gunzip.

@jbathegit I apologise for inconvenience. I most likely rename it so that I can upload it to gitHub.

Many thanks for your help with validation.

amilan17 commented 1 year ago

https://github.com/wmo-im/CCT/wiki/Teleconference.13.July.2023 notes:

@SimonElliottEUM @SibylleK validate within a week and ready to go if no feedback

SibylleK commented 1 year ago

I have successfully validated the example BUFR using the new sequence of the branch. (There was a typo for 033003. I corrected that in the branch.)

Here the output of the DWD bufr reading software: 20230327030016_Lat_46.812245_Lon_6.944007.nc.new.bufr.DWDreadbufrxOutput.zip

The values are the same as in the ECMWF output.

amilan17 commented 1 year ago

Thank you @SibylleK !