wmo-im / wmds

WIGOS Metadata Standard: Semantic standard and code tables
16 stars 22 forks source link

1-01-01 Align radiation variables requirements #389

Closed fstuerzl closed 6 months ago

fstuerzl commented 2 years ago

Proposal Summary

Summary and Purpose

Provide consistent names and descriptions/definitions for radiation terminology; align terminology in use in OSCAR/Surface (based on the WMO codes registry) and OSCAR/Requirements.

Proposal

Add definitions and include the term "radiation" in the UV variables:

notation path name description
267 \Atmosphere\Radiation\Background luminance Background luminance Luminous flux received from the background per unit solid angle and per unit area. Note: Luminous flux is a quantity derived from radiant flux by evaluating the radiation according to its action upon the International Commission on Illumination standard photometric observer.
270 \Atmosphere\Radiation\Sunshine duration Sunshine duration The total time in one day during which the direct solar irradiance is equal to or more than the threshold value for bright sunshine (the threshold being 120 W m–2 of direct solar irradiance).
271 \Atmosphere\Radiation\Surface albedo Surface albedo Hemispherically integrated reflectance of the Earth surface in the range 0.4-0.7 µm.   
273 \Atmosphere\Radiation\UV\UV-B radiation UV-B radiation Ultraviolet radiation covering the range 280-315 nm.
356 \Atmosphere\Radiation\UV\UV Broadband radiation UV Broadband radiation Spectrally integrated UV radiation 
357 \Atmosphere\Radiation\UV\UV Erythemal radiation UV Erythemal radiation Radiation effective in causing actinic erythema.
358 \Atmosphere\Radiation\UV\UV Multiband radiation UV Multiband radiation UV radiation measured across several discrete, narrow wavebands (e.g. 10 nm) within the UV range, providing coarse spectral information
359 \Atmosphere\Radiation\UV\UV Spectral radiation UV Spectral radiation UV radiation measured at continuous and higher spectral resolution (e.g. 1 nm) than multiband UV radiation.
Replace the name and add a description for the following variables: notation current name new name new description
566 Long-wave radiation (downwelling) Downward long-wave irradiance Flux density of downwelling long-wave radiation, at a specified level within the atmosphere, including the Earth surface.
567 Long-wave radiation (upwelling) Upward long-wave irradiance Flux density of upwelling long-wave radiation, at the top of the atmosphere or at a specified level within the atmosphere, including the Earth surface.
565 Long-wave radiation (direction unspecified) Long-wave irradiance (direction unspecified) Flux density of long-wave radiation (direction unspecified) at a specified level within the atmosphere, including the Earth surface. Long-wave radiation is the radiation at wavelengths greater than 3 μm (3000 nm), including most of the spectrum emitted by sources at terrestrial temperatures.
571 Diffuse solar radiation Diffuse downward short-wave irradiance Flux density of diffuse short-wave solar radiation, at a specified level within the atmosphere, including the Earth surface.
572 Direct solar radiation Direct downward short-wave irradiance Flux density of direct downwelling short-wave solar radiation, at the top of the atmosphere or at a specified level within the atmosphere, including the Earth surface.
573 Global solar radiation (downwelling) Downward short-wave irradiance Flux density of downwelling short-wave solar radiation, at the top of the atmosphere or a specified level within the atmosphere, including the Earth surface. [The term “global (downward) shprtwave irradiance’ is sometimes used to specify that this flux is the sum of direct and diffuse components.]
574 Global solar radiation (upwelling) Upward short-wave irradiance Flux density of upwelling short-wave radiation, at the top of the atmosphere or a specified level within the atmosphere, including the Earth surface.

Include the following new variables in table 1-01-01 (Atmosphere):

notation name description tags path
new id Net short-wave irradiance Flux density of short-wave solar radiation, as the difference between downwelling and upwelling radiation (positive for net downward), at the top of the atmosphere or at a specified level within the atmosphere, including the Earth surface.  Radiation \Atmosphere\Radiation
new id Short-wave irradiance (direction unspecified) Flux density of short-wave radiation (direction unspecified) at a specified level within the atmosphere, including the Earth surface. Short-wave radiation includes most of the solar radiation spectrum in the atmosphere from 280 nm to 3000 nm (3 μm). Radiation  \Atmosphere\Radiation
new id Net long-wave irradiance Flux density of upwelling long-wave radiation, as the difference between downwelling and upwelling radiation (positive for net downward) at a specified level within or at the top of the atmosphere, including the Earth surface.   Radiation \Atmosphere\Radiation
new id Upward spectral radiance Upward radiant power per area unit, per solid angle, and per wavelength or wavenumber interval . Radiation \Atmosphere\Radiation
new id Downward spectral radiance Downward radiant power per area unit, per solid angle, and per wavelength or wavenumber interval . Radiation \Atmosphere\Radiation
new id Solar spectral irradiance Spectrally resolved flux density of radiation received from the sun at the top of the atmosphere Radiation \Atmosphere\Radiation
new id Solar total irradiance Spectrally integrated flux density of radiation received from the sun at the top of the atmosphere. Also called “Total solar irradiance (TSI)”. Radiation \Atmosphere\Radiation
new id Earth surface short-wave bidirectional reflectance Reflectance of the Earth surface as a function of the viewing angle and the illumination angle averaged over the range 0.4-0.7 µm. Radiation \Atmosphere\Radiation
new id Earth surface spectral bidirectional reflectance Reflectance of the Earth surface as a function of viewing angle, incidence angle and wavelength, spectrally resolved. [The distribution of this variable is represented by the Bidirectional Reflectance Distribution Function (BRDF) ] Radiation \Atmosphere\Radiation
new id Earth surface emissivity Emissivity of the Earth surface as a function of wavelength and viewing angle. Radiation \Atmosphere\Radiation
new id Long-wave earth surface emissivity Emissivity of the earth surface integrated over the thermal IR wavelength range and integrated hemispherically.   Radiation \Atmosphere\Radiation

Reason

Some radiation variables in OSCAR/Requirements currently have no corresponding WMDR variable:

Stakeholder(s)

@JohnEyre

Consultations

@laurentvuilleumier, @PeterBlattner, @AnnWebb

Context

[include references to manuals or guides that are reviewed to ensure alignment, if proposal differs then document how and why]

Expected Impact of Change

LOW for new codes and changes of names and descriptions

fstuerzl commented 2 years ago
In this context it also needs to be analysed, how the O/R variable "Radiation profile" can be expressed in WMDR terms. It is defined as "Vertical profile of upward and downward LW and SW radiation components". Does it make sense to introduce a collective term, such as "Radiation components"? This would allow the following mapping: O/R WMDR
Variable: Radiation profile Observed variable: "Radiation components" + geometry: "vertical profile"
JohnEyre commented 2 years ago

Hi Franziska, Re: radiation profile. I suggest we take this one back to WIGOS/RRR. Although “radiation profile” is a variable name in OSCAR/Requirements, no Application Area currently “owns” any requirements for it. We should draw this to their attention and ask them to reconsider both the variable name and its definition. John

From: Franziska Stürzl @.> Sent: 27 April 2022 14:38 To: wmo-im/wmds @.> Cc: Eyre, John @.>; Assign @.> Subject: Re: [wmo-im/wmds] 1-01-01 Align radiation variables with OSCAR/Requirements and add definitions (Issue #389)

This email was received from an external source. Always check sender details, links & attachments.

In this context it also needs to be analysed, how the O/R variable "Radiation profile" can be expressed in WMDR terms. It is defined as "Vertical profile of upward and downward LW and SW radiation components". Does it make sense to introduce a collective term, such as "Radiation components"? This would allow the following mapping: O/R WMDR Variable: Radiation profilehttps://space.oscar.wmo.int/variables/view/radiation_profile Observed variable: "Radiation components" + geometry: "vertical profile"

— Reply to this email directly, view it on GitHubhttps://github.com/wmo-im/wmds/issues/389#issuecomment-1111014261, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AWHTXRVWQ7D5FRSD7TKWZTTVHE7KJANCNFSM5UPDZJFA. You are receiving this because you were assigned.Message ID: @.**@.>>

JohnEyre commented 2 years ago

See my comment on "radiation profile" above. For all the other new variables, these are requests for OSCAR/Requirements for inclusion in WMDR. They appear to have acceptable names and definitions, but comments welcome from others.

amilan17 commented 2 years ago

@amilan17 - send this issue to Heikki Pohjola (WMO Secretariat for Space) who may have feedback or be able to help identify others to help review this proposal.

JohnEyre commented 2 years ago

Following on from my comment above "Although “radiation profile” is a variable name in OSCAR/Requirements, no Application Area currently “owns” any requirements for it. We should draw this to their attention and ask them to reconsider both the variable name and its definition.", I am adding this to my list of issues for consideration by WIGOS RRR.

amilan17 commented 2 years ago

subset of issue #190

joergklausen commented 2 years ago

I insist that the existing variables (terms) are scrutinized and properly updated if needed before we add more variables lightly. The terminology 'radiation' vs 'radiance' vs 'irradiance' refers vaguely to the same thing, but I know that some people would insist on one over the other. The existing terms were created and looked at by experts at the time, and I am requesting they be consulted (again). Names I suggest are Ann Webb (UK), Laurent Vuilleumier (MCH), and Julian Gröbner (PMOD/WRC).

fierz commented 2 years ago

I strongly support @joergklausen's request to have the named experts look at those terms/variables. I also feel there may be some duplications as well as a non-consistent use of terminology here. Ann Webb on board would be great as there would be a direct link to both the International Commission on Illumination (CIE) and the GIMO (WMO-No 8).

JohnEyre commented 2 years ago

@joergklausen @fierz @amilan17 @fstuerzl . I have checked these 6 variables in OSCAR/Requirements. There are 5 RRR Application Areas that have stated requirements for observations of some or all these variables: Global NWP, High-resolultion NWP, Nowcasting, Climate Monitoring (GCOS), Hydrology. I have also checked OSCAR/Space and, in most cases, there are tens of satellite instruments listed as contributing to the observation of these variables. However, I agree that the experts consulted on these issues (i.e. on the requirements, or on the space-based observing capabilities) have probably not given much thought to the exact names of the variables or their definitions. This task (of careful thought) was done by the WMO consultant tasked with proposing the variable names and definitions used in OSCAR/Requirements+Space, and these proposals were subsequently reviewed and accepted by the relevant CBS Expert Team (IPET-OSDE, which has now become JET-EOSDE). So I suggest that these variable names and definitions have already undergone considerable review, but only from the perspective of RRR. It would be beneficial to obtain a review by someone independent of the RRR process. However, as most of the relevant observations are from space, I suggest it should be someone familiar with these technologies. Comments welcome.

fierz commented 2 years ago

@JohnEyre Thanks for clarifying with OSCAR/Space and RRR. In my view there is quite a redundancy in the variables proposed in the initial lists above. For example, Long-wave earth surface emissivity is very close to Long-wave radiation (upwelling), etc. Thus I agree that experts of both surface and space measurements need to sort this out. Note that one of the experts proposed by @joergklausen, Julian Gröbner, works in an institute also dealing with space measurements and he may act as the 'bridging expert' …

JohnEyre commented 2 years ago

@fierz . Emissivity is a dimensionless quantity, between 0 and 1. (Normally, emissivity = 1 - reflectivity.) In the thermal infra-red, which is where it matters for many observations and applications, emissivity is close to 1 for the ocean surface and for vegetated surfaces, but differs substantial from 1 for deserts and bare soils, and for some ice surfaces. It's also important to know the emissivity in the microwave, where it is substantially less than one for the ocean surface. Surface emissivity can be retrieved from some satellite measurements. Atlases of emissivity are also required for the processing of other types of satellite data. So it differs substantially from measurements of radiation (radiances and irradiances, spectrally specific or spectrally integrated) at the surface (or the top of the atmosphere), as these are typical measured in units of W.m-2 (integrated over wavelength) or spectrally specific quantities in W.m-2.(cm-1)-1 or W.m-2.(cm-1)-1.sr-1.

laurentvuilleumier commented 2 years ago

Following @joergklausen request let me include a few comments below (I am Laurent Vuilleumier):

The distinction between radiance and irradiance is implicitly addressed by indicating the radiance is the radiant power per solid angle per unit area (we could add “crossing a surface perpendicular to the radiation beam”), while the irradiance is a flux density on a given surface (same surface for radiation from all directions, it is more instrument-related). Since the flux density is a radiation power through a surface (Wm-2), it follows that irradiance is the radiance “directionally”-integrated over a hemisphere. With this, I mean that the integration through the hemisphere includes a cos(theta) term to take into account the orientation of the incoming radiance with respect to the surface through which the irradiance is measured. More precisely, the integration is Integral( Radiance cos(theta) dOmega ), where dOmega is sin(theta) dphi dtheta, which gives Integral( Radiance cos(theta) sin(theta) dphi dtheta) where the integral runs for phi = 0,2pi and for theta = 0,pi.

I think this can be surmised from the definitions. Giving the difference between radiance and irradiance more precisely requires including formulas because describing it in writing as above is not optimal.

This said, I cannot distinguish “Downward short-wave irradiance” and “Global solar radiation (downwelling)” (573) or “Upward short-wave irradiance” and “Global solar radiation (upwelling)” (574), except if the new proposed definitions are meant for satellite-use and are related to TOA quantities. However, in name themselves (Downward short-wave irradiance, Upward short-wave irradiance or Upward spectral radiance), there is nothing to indicate these are TOA quantities. By the way, in the definition of upward spectral radiance, it is mentioned in the definition that it is measured at the TOA. But except if it is decided from now on from this definition that upward spectral radiance is measured at TOA, I see nothing in the name that says this.

Finally, I find confusing to use “Total Solar Irradiance” as the first definition item of the solar spectral irradiance, since I always thought “total” meant integrated over all wavelengths, which the solar spectral irradiance is precisely not. I would rather use a definition such as “spectral solar radiation density flux through a surface perpendicular to the solar beam in W m-2 nm-1. The Total Solar Irradiance results from the integration of the solar spectral irradiance over all wavelengths”.

JohnEyre commented 2 years ago

@laurentvuilleumier @joergklausen . In OSCAR/Requirements, "TOA" or "Surface" are included as part of the variable name. We have discussed this in TT-WIGOSMD and (tentatively) agreed that, for WMDR, it is better to keep "TOA" and "Surface" separate from the name of the geophysical variable, and to specify it through the "Layer" descriptor. On "Total solar irradiance", I agree - "total" here means "integrated over wavelength" and so is not appropriate as part of the definition of solar spectral irradiance. (I think the reason for its inclusion is intended to be explanatory and not part of the definition - historically, satellite instruments have measured total irradiance but, more recently, there have also been instruments to measure the spectral irradiance.)

fierz commented 2 years ago

Thanks @laurentvuilleumier

Your remark

I cannot distinguish “Downward short-wave irradiance” and “Global solar radiation (downwelling)” (573) or “Upward short-wave irradiance” and “Global solar radiation (upwelling)” (574)

is very pertinent and I am truly sorry I chose the wrong variables above to make the case. BTW, I by far prefer “Upward short-wave irradiance” with its clear description than the much less appropriate “Global solar radiation (upwelling)” (574)_ .

@JohnEyre be assured I know the difference between emissivity, the ratio of the thermal radiation from a surface to the radiation from an ideal black surface at the same temperature, a variable on its own indeed, and other measurements of radiation.

laurentvuilleumier commented 2 years ago

@JohnEyre, @fierz: OK, it seems the distinction between Downward short-wave irradiance and Global solar radiation (downwelling) as well as... is indeed their use as satellite-related (rather TOA) and ground-based measured (rather surface) quantities. The TOA vs. surface quality seems to be mentioned in another part of the description (layer) that was not apparent in this issue. It is fine with me and could help people making the connection between the variables and associated physical quantities, typically when validating satellite-derived quantities with surface measurements. In this case, I would really advocate including a note in the description mentioning that the variables Downward short-wave irradiance and Global solar radiation (downwelling) as well as... are referring to the same physical quantities in satellite vs. ground-based measured context, respectively. I have to say that I agree with @fierz that the name Global solar radiation (upwelling) is not a very fitting choice. Upward short-wave irradiance is indeed better or eventually “upward reflected solar radiation”. However, I think the name of 574 has already been defined. I also noticed I made a mistake in my description of the radiance integration into irradiance: the integration over theta runs from 0 to pi/2 and not 0 to pi. radiance_to_irradiance

JohnEyre commented 2 years ago

@laurentvuilleumier @fierz @joergklausen . This Issue (#389) arose out of the discussion on achieving consistency between WMDR and OSCAR/Requirements. So the variables under discussion here are those for which a requirement-to-observe has been stated by one or more WIGOS Applications Areas. Hence they are geophysical variables on which observational information (direct or indirect) has been requested. They don't necessarily correspond to variables than can be observed directly, either from surface or from space. At Joerg's request, I have opened a new Issue (#414) to start to build a list of Level 1 variables (i.e. mainly engineering variables rather than geophysical variables) measured by satellite instruments (and in principle by other remote sensing systems). I can already see that there will be some overlaps between #389 and #414, but I hope we can resolve these as we proceed.

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/Meeting-2022.09.22 notes:

gaochen-larc commented 1 year ago

Contacted Schuster, Gregory L. (LARC-E302) gregory.l.schuster@nasa.gov. He will make comments directly or through me in a few weeks.

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/2022.10.06-TT-WIGOSMD meeting notes:

@gaochen-larc said that we may need another expert from NOAA or ESA to review

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/2022.10.20-TT-WIGOSMD notes:

gaochen-larc commented 1 year ago

Would like to add a variable: Actinic Flux

Here is the AMS definition: The spherically integrated radiation flux in the earth's atmosphere that originates from the sun, including the direct beam and any scattered components.

fstuerzl commented 1 year ago

I've updated the proposal, by adding two definitions from OSCAR/Requirements to the variables "Background luminance" and "Surface albedo". For the other radiation variables in WMDR, which are currently not defined, @JohnEyre and I propose to open another issue.

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/2022.11.03-TT-WISOSMD notes: @fstuerzl: added definitions where possible, needs review, recommends opening new issue for remainder of codes @JohnEyre recommends a review from individuals who works on space based observations @meulenvd recommends looking at WMO-No. 8, there is a chapter on radiation

JREyre commented 1 year ago

@amilan17 @meulenvd Please could you provide a link to WMO-No.8. Thanks.

joergklausen commented 1 year ago

https://community.wmo.int/activity-areas/imop/wmo-no_8 Guide to Instruments and Methods of Observation (WMO-No. 8) | World Meteorological Organizationhttps://community.wmo.int/activity-areas/imop/wmo-no_8 community.wmo.inthttps://community.wmo.int/activity-areas/imop/wmo-no_8 [favicon.ico] https://community.wmo.int/activity-areas/imop/wmo-no_8

Sent from my iPhone

On 3 Nov 2022, at 16:13, JREyre @.***> wrote:

WMO-No.8

JREyre commented 1 year ago

Hi Joerg,

Thanks for these links, but none of them works for me – they just give “page not found”.  However, I can find something by googling WMO No-8.  Then a (seemingly identical) link takes me to:

https://community.wmo.int/activity-areas/imop/wmo-no_8

This page gives the table of contents of the 2018 edition.  It says that Chapter 7 is on “Measurement of radiation” but the link to this chapter (as for other chapters) does not work.

I’ve looked at various other links to parts of the 2018 edition, but none of these appears to include the chapter on radiation.

Can anyone help with this?

John

From: Jörg Klausen @.> Reply to: wmo-im/wmds @.> Date: Thursday, 3 November 2022 at 21:14 To: wmo-im/wmds @.> Cc: JREyre @.>, Comment @.***> Subject: Re: [wmo-im/wmds] 1-01-01 Align radiation variables with OSCAR/Requirements and add definitions (Issue #389)

https://community.wmo.int/activity-areas/imop/wmo-no_8 Guide to Instruments and Methods of Observation (WMO-No. 8) | World Meteorological Organizationhttps://community.wmo.int/activity-areas/imop/wmo-no_8 community.wmo.inthttps://community.wmo.int/activity-areas/imop/wmo-no_8 [favicon.ico] https://community.wmo.int/activity-areas/imop/wmo-no_8

Sent from my iPhone

On 3 Nov 2022, at 16:13, JREyre @.***> wrote:

WMO-No.8

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

fstuerzl commented 1 year ago

Hi John, Maybe try this link: https://library.wmo.int/doc_num.php?explnum_id=11337 It should lead you to the PDF of the 2020 version. I always use the search function in the WMO library (https://library.wmo.int/index.php?lang_sel=en_UK), where you can simply enter the WMO-No.

JREyre commented 1 year ago

Many thanks, Franziska.  That’s what I was looking for.

From: Franziska Stürzl @.> Reply to: wmo-im/wmds @.> Date: Friday, 4 November 2022 at 11:03 To: wmo-im/wmds @.> Cc: JREyre @.>, Comment @.***> Subject: Re: [wmo-im/wmds] 1-01-01 Align radiation variables with OSCAR/Requirements and add definitions (Issue #389)

Hi John, Maybe try this link: https://library.wmo.int/doc_num.php?explnum_id=11337 It should lead you to the PDF of the 2020 version. I always use the search function in the WMO library (https://library.wmo.int/index.php?lang_sel=en_UK), where you can simply enter the WMO-No.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

meulenvd commented 1 year ago

Dear all,

Please note that the link below is for Vol. I only. There are 5 Volumes, see Guide to Instruments and Methods of Observation (W... | E-Library (wmo.int)https://library.wmo.int/index.php?lvl=notice_display&id=12407#.Y2UtDtfMKUk I: 2020 edition - Volume I: Measurement of Meteorological Variables https://library.wmo.int/doc_num.php?explnum_id=11337 II: 2018 edition - Volume II: Measurement of Cryospheric Variables https://library.wmo.int/doc_num.php?explnum_id=9870 , III: 2020 edition - Volume III: Observing Systems https://library.wmo.int/doc_num.php?explnum_id=11338 , IV: 2020 edition - Volume IV: Space-based Observations https://library.wmo.int/doc_num.php?explnum_id=11349 , V: 2018 edition - Volume V: Quality Assurance and Management of Observing Systems https://library.wmo.int/doc_num.php?explnum_id=9869

During the recent INFCOM meeting a number of updated chapters are approved, so new 2022 versions may be expected in the WMO library soon. Chapters on the observing methods associated to variables is in Vol I (like radiation); Vol IV is dedicated to the observing technology by satellite sensors. Data issues are discussed in Vol I and Vol V.

Nice weekend, -Jitze

Dr Jitze P. van der Meulen senior scientist (guest) ........................................................................ KNMI | RDWD Ministry of Infrastructure and Water Management Utrechtseweg 297 | 3731 GA | De Bilt Postbus 201 | 3730 AE | De Bilt | the Netherlands ........................................................................ M +31 (0)6 23493712 E @.**@.>

From: Franziska Stürzl @.> Sent: 04 November 2022 12:04 To: wmo-im/wmds @.> Cc: Meulen van der, Jitze (KNMI) @.>; Mention @.> Subject: Re: [wmo-im/wmds] 1-01-01 Align radiation variables with OSCAR/Requirements and add definitions (Issue #389)

Hi John, Maybe try this link: https://library.wmo.int/doc_num.php?explnum_id=11337 It should lead you to the PDF of the 2020 version. I always use the search function in the WMO library (https://library.wmo.int/index.php?lang_sel=en_UK), where you can simply enter the WMO-No.

— Reply to this email directly, view it on GitHubhttps://github.com/wmo-im/wmds/issues/389#issuecomment-1303271278, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AWR5A4UELPLLQUK4PVW4UNLWGTURRANCNFSM5UPDZJFA. You are receiving this because you were mentioned.Message ID: @.**@.>>

JREyre commented 1 year ago

@meulenvd @fstuerzl @joergklausen @amilan17 Hi Jitze, Many thanks for this list which is very helpful.
There are definitions of some radiation terms in Vol.I (Chapter 7), but too general for use in this task.
There is a list of radiation variables and their definitions in Vol.IV (Annex to Chapter 5). This is very helpful. These are (almost) consistent with those in WMDR and OSCAR/Requirements, suggesting that they have a common root. So this checks the consistency within WMO documents that we were seeking to confirm.
The only differences I can see are as a result of our recent work - by removing the qualifier TOA (= top of the atmosphere) from some variables, we have created an inconsistency between the variable and its definition. I will work on how to resolve these. John

JREyre commented 1 year ago

@joergklausen @amilan17 @fstuerzl @fierz @laurentvuilleumier @gaochen-larc @meulenvd I have reviewed again all the comments on this issue. Thanks to all who have contributed. Here is my summary of the outstanding issues and my proposals for how we should address them:

  1. By removing "surface" and "TOA" from some variable names, we have created 2 anomalies with the definitions of the variables, and I propose that we fix these as follows:

    • Upward short-wave irradiance. Change definition to "Flux density of solar radiation, reflected upwards by the Earth surface and/or atmosphere, measured at a specified level within or at the top of the atmosphere".
    • Upward spectral radiance. Change definition to "Upward radiative power per unit area, per unit solid angle, per unit wavelength interval, measured at a specified level within or at the top of the atmosphere".
  2. I have noted the comment that "Global solar radiation (upwelling)" is not a very fitting choice". I agree. However, this is not one of the variables considered under #389. and so I suggest it is considered separately.

  3. I have noted the proposal to add "Actinic flux". This is not a variable with which I am familiar, and it is not on the list under #389, and so I suggest it is considered separately.

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/2022.11.22-TT-WIGOSMD notes:

joergklausen commented 1 year ago

Ask Wolfgang Finsterle (PMOD/WRC) and Peter Blattner (Metas) for review eventually.

amilan17 commented 1 year ago

New provisional version of WMO-No. 8

https://community.wmo.int/activity-areas/imop/wmo-no.8/wmo-no-8-provisional-2023-edition

JREyre commented 1 year ago

@joergklausen @amilan17 @fstuerzl @gaochen-larc I have created a spreadsheet (attached) containing all the radiation variables (all those with radiation units) in WMDR and OSCAR/Requirements. There are 49 in total. Most are associated with solar observations and/or requirements for Space Weather applications. I will analysed these variables (+ Actinic Flux) for consistency and redundancy, and make some proposals. Radiation variables 221123.xlsx

JREyre commented 1 year ago

@joergklausen @amilan17 @fstuerzl @gaochen-larc I have now completed my analysis of the spreadsheet linked above and prepared the attached note which includes a proposal for how #389 should be modified.
Review of radiation variables 221128.pdf

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/2022.12.08-TT-WIGOSMD notes: @gaochen-larc will send out John's review to two contacts.

joergklausen commented 1 year ago

From ISO 9488 (Solar energy — Vocabulary):

These definitions can be used as notes in our own definitions of radiation terms if deemed useful.

joergklausen commented 1 year ago

Please review definition of term "Earth surface short-wave bidirectional reflectance". It seems, units are missing where it says 'range 0.4-0.7'.

Also, please create branch for final review.

JREyre commented 1 year ago

@joergklausen @gaochen-larc Some comments on the input from Joerg:

joergklausen commented 1 year ago

@JREyre I was able to add the missing unit µm easily in 2 places. For the bidirectional reflectance, I tried to summarize your earlier comment in a shorter phrase. Please feel free to correct/expand. This is not my field of expertise ...

PeterBlattner commented 1 year ago

Dear colleagues,

@joergklausen invited me to comment on issue #389. I was involved in the revision of the CIE International Lighting Vocabulary (ILV, https://cie.co.at/e-ilv ) which is fully harmonized with the IEV part 845 (https://www.electropedia.org/iev/iev.nsf/index?openform&part=845 ). I am not really an expert on atmospheric radiation and some comments may therefore seem trivial or inappropriate.

In general, I would recommend that in addition to the quantity, the units are also described somewhere. For example at the end of the description " Downward short-wave irradiance" one could add "unit: W m-2".

Some comments for the individual entries:

Downward short-wave irradiance : According to the ILV the quantity "irradiance" https://cie.co.at/eilvterm/17-21-053 always refers to a point at a real or imaginary surface. Also I'm missing the "short-wave" in the description. Thus an alternative description could be: Flux density of the downward short wave solar radiation with respect to area at a point on a real or imaginary surface. unit: W m-2

Upward short-wave irradiance: similarly: Flux density of short-wave solar radiation, reflected by the Earth surface and atmosphere with respect to area at a point on a real or imaginary surface. unit: W m-2

Upward spectral radiance: The description is inconsistent with the description of the upward short wave irradiance as all of a sudden "top of the atmosphere" is introduced. Either add it to the " Upward short-wave irradiance" or remove it here. In addition the unit could be added : unit: W m-2 sr-1

Solar spectral irradiance: There is an inconsistency between the name and the description: According to my understanding "solar spectral irradiance" is a spectral quantity (https://cie.co.at/eilvterm/17-21-027 ) with unit : W m-2 nm-1 whereas the term total solar irradiance (TSI) is typically the solar spectral irradiance integrated over the full spectrum, unit: : W m-2 .

Earth surface short-wave bidirectional reflectance Again there is an inconsistency between the name and the description: The term "reflectance" relates to a dimensionless quantity (ratio of flux), see https://cie.co.at/eilvterm/17-24-064 , whereas the BRDF relates to a quantity with unit sr-1 as it is a quotient between a radiance and a irradiance. Why the wavelength range is no limited to 0.4 um to 0.7 um? According to the ISO 9488 the wavelength range of "short-wave" is different.

Long-wave earth surface emissivity There is an inconsistency between the name and the descirption: the description stipulates that it is a spectral quantity, hence "spectral" should be added in the name. Alternatively, the description can be revised ("Spectral emissivity of the earth surface integrated over the thermal IR wavelength range").

Hope you find these comments useful.

laurentvuilleumier commented 1 year ago

@joergklausen @JREyre

About John's comments to ISO definitions communicated by Jörg:

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/2023.01.12-TT-WIGOSMD notes:

AnnWebb commented 1 year ago

This is now a very long chain of comments, so rather than try and pick out previous comments and provide a response, I will simply give my views.

  1. I agree with Peter that units should be provided with all definitions - this can also help to ensure consistency. Also that anything 'spectral' should have units of 'per nm', albeit that we understand the measurement must be made across a small but finite waveband.

  2. There are inconsistencies/potential confusions with the terms 'surface' and 'top of atmosphere' (TOA). The radiation definition (e.g. radiance / irradiance) is the same whatever the surface through which the flux passes or is incident upon: the earth's surface, TOA, or some level in between (e.g. cloud top). Thus downward short-wave irradiance is a general (any surface) description while Total solar irradiance (the same radiation quantity) is specified only for TOA, as is solar spectral irradiance. This is confusing, and as someone who makes ground-based measurements I would say it is incorrect and TSI can also be used for the surface of the Earth. It is also known as Global solar irradiance, but I note this is to be superseded anyway. There should be a single definition for radiation quantity (irrespective of surface) and a comment to indicate this is (usually) the earth surface or TOA depending on measurement system/application. In the same vein, short-wave and solar are both used to mean the same thing (wavelengths of radiation received from the sun): should a single term be used throughout? Personally I prefer 'solar' as short-wave is subjective and certainly may mean other things in different disciplines, but I suspect I may lose that argument.

  3. There is no downward spectral radiance. Regarding the request to include actinic flux, actinic flux is understood as the spectral radiance integrated over 4pi, at least when referring to atmospheric chemistry. Actinic just means 'having a photochemical effect' and the spectral radiance is weighted for whichever reaction is under consideration. More generally 'actinic flux' could be the flux through any surface, so some care is needed in defining the term for use in this community.

  4. My understanding of albedo is the reflectance of downwelling short-wave radiation (or solar radiation) by a surface (e.g. Earth or TOA, the latter giving planetary albedo). While 'spectral albedo' or albedo for a particular waveband is sometimes specified (better to use spectral reflection), the general term refers to all wavelengths of solar radiation, not just the visible. The general term BRDF is also not confined to the visible, though there may be measurement techniques that only measure it in the visible. In any case, it is very wavelength dependent, even in the visible which we identify as colour.

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/2023.02.16-TT-WIGOSMD notes: combined with #426; Franziska and John are working on the revised proposal based on comments/reviews and will look at with Joerg. They will present results at a future meeting.

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/2023-03-17-TT-WIGOSMD notes: work in progress (combining with #426)

fstuerzl commented 1 year ago

The revised proposal (combining issue #389 and #426) is now published in the proposal summary above. Thanks to @JohnEyre and @joergklausen for their contributions!

Experts advise is still needed for the following variables/definitions:

amilan17 commented 1 year ago

@fstuerzl I'm going to create a new branch from master, because it will be too difficult to rebase.

amilan17 commented 1 year ago

https://github.com/wmo-im/tt-wigosmd/wiki/2023.04.21-TT-WIGOSMD: Franziska will work on branch