wmo-im / wmds

WIGOS Metadata Standard: Semantic standard and code tables
16 stars 22 forks source link

1-01-x Re-concile variable lists of OSCAR/Requirements with the official WMD codelists #190

Closed joergklausen closed 1 year ago

joergklausen commented 3 years ago

OSCAR/Requirements uses a list of variables that is not fully re-conciled with the official list of variables as found on codes.wmo.int/wmdr. Moreover, these variable also use numeric codes, but different numbers. Thus, not only are the entries partly different, but there is a risk that users may refer to a variable intended for machine-based metadata management in OSCAR/Surface from the list of OSCAR/Requirements. A concerted effort is needed to

john.eyre@metoffice.gov.uk is volunteering to help with this issue.

fstuerzl commented 3 years ago

The following tables contain OSCAR/Requirement variables, which are missing in the WIGOS vocabulary (and not yet included in another issue).

OSCAR Requirements domain: "Aerosol and radiation" ->domain: Atmosphere, new entries in table 1-01-01 name definition status
Aerosol Optical Depth The AOD is the effective depth of the aerosol column from the viewpoint of radiation propagation: Vertical column integral of spectral aerosol extinction coefficient AOD = exp(-K. Δz) where K is the extinction coefficient [km-1 ] and Δz the vertical path [km] discussion required
Aerosol species mole fraction 3D field of the mole fraction of condensed-phase chemical species (e.g., sulfate, nitrate, ammonium, elemental carbon, organic carbon), in the atmosphere discussion required
Downward short-wave irradiance at Earth surface Flux density of the solar radiation at the Earth surface discussion required
Downward short-wave irradiance at TOA Flux density of the solar radiation at the top of the atmosphere discussion required
Earth surface short-wave bidirectional reflectance Reflectance of the Earth surface as a function of the viewing angle and the illumination angle in the range 0.4-0.7 . The distribution of this variable is represented by the Bidirectional Reflectance Distribution Function (BRDF) discussion required
Long-wave Earth surface emissivity Emissivity of the Earth surface in the thermal IR, function of the wavelength discussion required
Upward short-wave irradiance at TOA Flux density of solar radiation, reflected by the Earth surface and atmosphere, emitted to space at the top of the atmosphere discussion required
Upward spectral radiance at TOA Upward radiant power measured at the top of the atmosphere per area unit, per solid angle, and per wavelength interval. Spectral range 0.2-200 µm. Resolving power ?/??= 1000. Accuracy quoted as SNR (Signal-to-Noise-Ratio), actually SNR^-1 so that smaller figure means better performance, as usual. discussion required
Upward long-wave irradiance at TOA Flux density of terrestrial radiation emitted by the Earth surface and the gases, aerosols and clouds ot the atmosphere at the top of the atmosphere discussion required
Aerosol single-scattering albedo The spectrally dependent ratio of the aerosol scattering to the aerosol extinction discussion required
Aerosol Layer Height Height of vertically localized aerosol layer in the free troposphere above sea level discussion required
Solar spectral irradiance Total Solar Irradiance (TSI); when measured as a function of wavelength it is the spectral irradiance discussion required
Radiation profile Vertical profile of upward and downward LW and SW radiation components discussion required

OSCAR Requirements domain: "Atmospheric chemistry" ->domain: Atmosphere, new entries in table 1-01-01

name definition status
OH 3D field of amount of OH (Hydroxil radical, expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) uncontroversial, adapt description
C10H16 (alfapinene) Mole Fraction 3D field of amount  of C10H16 (alfapinene,expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles).   uncontroversial, also included in #255
C10H16 (betapinene) Mole Fraction 3D field of amount of C10H16 (betapinene, expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) uncontroversial, adapt name and description
C10H16 (3-Carene) Mole Fraction 3D field of amount  of C10H16 (3-Carene, expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) uncontroversial, adapt name and description
C10H16 (Limonene) Mole Fraction 3D field of dry air mole fraction of C10H16 (Limonene, expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles). uncontroversial, adapt name and description
(14)CO2 Delta 3D field of Delta C-14 in CO2 (Carbon dioxide) (isotopic signature)
C(18)OO Delta 3D field of Delta O-18 in CO2 (Carbon dioxide) (isotopic signature)
(13)CH4 Delta 3D field of Delta C-13 in CH4 (Methane) (isotopic signature)
(14)CH4 Delta 3D field of Delta C-14 in CH4 (Methane) (isotopic signature)
CH3D Delta 3D field of Delta Deuterium (H-2) in CH4 (Methane) (isotopic signature)
(13)CO Delta 3D field of Delta C-13 in CO (Carbon monoxide) (isotopic signature)
(14)CO Number Concentration 3D field of amount of CO (Carbon monoxide) with C-14 isotope (mol) per air volume (m3)
C(18)O Delta 3D field of Delta O-18 in CO (Carbon monoxide) (isotopic signature)
N(15)NO Delta 3D field of Delta N-15 in N2O (Nitrous oxide) (isotopic signature)
N2(18)O Delta 3D field of Delta O-18 in N2O (Nitrous oxide) (isotopic signature)
C(17)OO Delta 3D field of Delta O-17 in CO2 (Carbon dioxide) (isotopic signature)
Glyoxal Mole Fraction 3D field of amount of OCHCHO (Glyoxal, expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles)
(13)CO2 Delta 3D field of Delta C-13 in CO2 (Carbon dioxide) (isotopic signature)
N(15)NO-Alpha Delta 3D field of Delta N-15 in Alpha-N2O (Nitrous oxide where the outer Nitrogen atom is N-15)  (isotopic signature)
N(15)NO-Beta Delta 3D field of Delta N-15 in Beta-N2O (Nitrous oxide where the middle Nitrogen atom is N-15) (isotopic signature)
CO2 Mole fraction (SR) 3D field of amount of  source region (SR) CO2 (Carbon Dioxide) (expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) discussion required
CO2 Mole fraction (BG) 3D field of amount of  background (BG) CO2 (Carbon Dioxide) (expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) discussion required
HD Delta 3D field of Delta Deuterium (H-2) in HD (molecular Hydrogen) (isotopic signature)
HCHO Tropospheric column 2D field of total amount of HCHO molecules per unit area in an atmospheric column extending from the Earth’s surface to the tropopause. uncontroversial, adapt name (remove "tropospheric column") and definition
Glyoxal Tropospheric column 2D field of tropospheric column averaged of amount of Glyoxal (expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles)
CH4 Mole fraction (BG) 3D field of amount of  background (BG) CH4 (Carbon Dioxide) (expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) discussion required
CH4 Mole fraction (SR) 3D field of amount of  source region (SR) CH4 (Carbon Dioxide) (expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) discussion required
NO2 Mole fraction (BG) 3D field of amount of  background (BG) NO2 (expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) discussion required
NO2 Mole fraction (SR) 3D field of amount of Source Region (SR) NO2 (expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) discussion required
NO3 Mole Fraction 3D field of amount of NO3 (expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) uncontroversial, adapt name and description
N2O5 3D field of amount of N2O5 (expressed in moles) divided by the total amount of all constituents in dry air (also expressed in moles) uncontroversial, adapt description
OSCAR Requirements domain: "Basic atmospheric" ->domain: Atmosphere, new entries in table 1-01-01 name definition status
Atmospheric temperature 3D field of the atmospheric temperature discussion required
Height of the tropopause Height of the surface separating the troposphere from the stratosphere uncontroversial
Temperature of the tropopause Atmospheric temperature at the height of the surface separating the troposphere from the stratosphere discussion required
Relative humidity 3D field of relative humidity in the atmosphere. Relative humidity is the ratio of the amount of atmospheric moisture present relative to the amount that would be present if the air were saturated with respct to water or ice to be specified in the metadata discussion required
OSCAR Requirements domain: "Solar monitoring" ->domain: Outer Space, new entries in table 1-01-02 name definition status
UV flux spectrum Energy spectrum of diffuse UV flux measured in space. discussion required
VIS flux Integrated VIS flux discussion required
VIS flux spectrum Energy spectrum of diffuse VIS flux measured in space discussion required
VIS sky image VIS image of the sky discussion required
NIR/SWIR flux Integrated NIR/SWIR flux discussion required
NIR/SWIR flux spectrum Energy spectrum of diffuse NIR/SWIR flux measured in space discussion required
NIR/SWIR sky image NIR/SWIR image of the sky discussion required
amilan17 commented 3 years ago

@amilan17 reach out to SC-ON, for team on WIGOS requirements.

efucile commented 3 years ago

@amilan17 reach out to SC-ON, for team on WIGOS requirements.

reach out to JET-OSDE

fstuerzl commented 3 years ago

Variable mapping between OSCAR/Requirements and WMDR code lists for observed variables (state 03/2021): variable_mapping_WMDR_OR.xlsx

amilan17 commented 2 years ago

John Eyre from UK Met Office will help with this effort

joergklausen commented 2 years ago

Please see https://github.com/wmo-im/wmds/wiki/Alignment-of-OSCAR-Requirements-(O-R)-and-OSCAR-Space-(O-Space)-with-WMD-vocabulary-for-variables for an outline of the background, objectives and suggested approach. @JohnEyre Comments are welcome

fstuerzl commented 2 years ago

New document including all currently operational WIGOS variables: variable_mapping_WMDR_OR_2021-11.xlsx Variables added in FT-2021-2 have the status "new - to be mapped" and were not yet compared with the OSCAR/Requirements variables. This updated excel file can be used as the basis for work on this issue.

JohnEyre commented 2 years ago

Thanks, Franziska. How would you like me to interact with this xlsx file? Should I just add more comments to the “Comments” column? John

From: Franziska Stürzl @.> Sent: 11 November 2021 15:28 To: wmo-im/wmds @.> Cc: Eyre, John @.>; Assign @.> Subject: Re: [wmo-im/wmds] 1-01-x Re-concile variable lists of OSCAR/Requirements with the official WMD codelists (#190)

This email was received from an external source. Always check sender details, links & attachments.

New document including all currently operational WIGOS variables: variable_mapping_WMDR_OR_2021-11.xlsxhttps://github.com/wmo-im/wmds/files/7521437/variable_mapping_WMDR_OR_2021-11.xlsx Variables added in FT-2021-2 have the status "new - to be mapped" and were not yet compared with the OSCAR/Requirements variables. This updated excel file can be used as the basis for work on this issue.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHubhttps://github.com/wmo-im/wmds/issues/190#issuecomment-966394423, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AWHTXRVPPZZTYMFE7YCKWQ3ULPOH5ANCNFSM4RUSNXLA. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

fstuerzl commented 2 years ago

@JohnEyre, if there are exact matches between O/R and WIGOS variables, I'd suggest, it is most convenient, if you move the WIGOS variable to same line that contains the corresponding O/R variable. Otherwise comments are fine of course.

amilan17 commented 2 years ago

Elios Cloud version of the XSL spreadsheet

fstuerzl commented 2 years ago

This issue will be split up into multiple sub-issues:

amilan17 commented 2 years ago

This issue will be split up into multiple sub-issues:

@fstuerzl when you create new issues related to this one, can you add a comment noting that it's related to this issue? see issues above for examples. thx.

JohnEyre commented 2 years ago

@amilan17 . I think the radiation variables are in pretty good shape. The one that needs attention is "radiation profile", and I am planning to take this back to WIGOS/RRR because I can't find any RRR Application Area that has currently stated a requirement for observations of this variable in OSCAR/Requirements. Without a requirement, it is not clear with whom to liaise about a suitable definition.

JREyre commented 1 year ago

@fstuerzl @joergklausen @amilan17 This Issue is now rather old. Some of the more difficult problems have been transferred to other Issues. Others problems were raised at the JET-EOSDE Workshop in Sept 2022, and this resulted in Actions on several JET members. I propose to await progress on these Actions and, if successful, then to recommend to you that we close this Issue.

JREyre commented 1 year ago

@joergklausen @amilan17 @fstuerzl I think all the issues that were originally raised under #190 are now complete or covered elsewhere. Do you agree? If so, can we close #190.

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/2023.06.30-TT-WIGOSMD notes:

team agrees to close the issue;