Table 9-02 Data policy

[amilan17]

Initial request

The new WMO Unified Data Policy was accepted by Cg-Ext-2021 as Resolution 1. It replaces WMO Resolutions 40, 25, 60 and 80. Similar to these depracated resolutions, the new Resolution 1 defines data classes and the policies that apply to them with regards to international data exchange. It has 2 categories: core data and recommended data. This CR proposes definitions to these two new elements, and their relationship with the existing code list elements. The existing elements in the WMO codes registry for (DataPolicy)[https://codes.wmo.int/wmdr/DataPolicy] include

notation	label	definition
WMOEssental	WMOEssential	WMO Essential Data: free and unrestricted international exchange of basic data and products.
WMOAdditional	WMOAdditional	WMO Additional Data: free and unrestricted access to data and products exchanged under the auspices of WMO to the research and education communities for non-commercial activities. A more precise definition of the data policy may be additionally supplied within the metadata. In all cases it shall be the responsibility of the data consumer to ensure that they understand the data policy specified by the data provider - which may necessitate dialogue with the data publisher for confirmation of terms and conditions.
WMOOther	WMOOther	Data identified for global distribution via WMO infrastructure (GTS / WIS) that is not covered by WMO Resolution 25 neither WMO Resolution 40; e.g. aviation OPMET data. Data marked with ''WMOOther'' data policy shall be treated like ''WMOAdditional'' where a more precise definition of the data policy may be additionally supplied within the metadata. In all cases it shall be the responsibility of the data consumer to ensure that they understand the data policy specified by the data provider - which may necessitate dialogue with the data publisher for confirmation of terms and conditions.

Amendment details

ADD following elements

notation	label	definition
WMOCore	WMOCore	Earth system data that are necessary for the provision of services in support of the protection of life and property and for the well-being of all nations, at a minimum those data described in Annex 1 to WMO Resolution 1 (https://library.wmo.int/records/item/58009-wmo-unified-data-policy), which are required to monitor and predict seamlessly and accurately weather, climate, water and related environmental conditions. WMO Members shall provide core data on a free and unrestricted basis. The data policy for WMO core data is similar in scope to the previous one for WMO essential data.
WMORecommended	WMORecommended	Earth system data that are required to support Earth system monitoring and prediction activities at the global, regional and national levels and to further assist other WMO Members with the provision of weather, climate, water and related environmental services in their States and Territories. WMO Members should provide access to all recommended data exchanged under the auspices of WMO without charge to public research and education communities for their non-commercial activities, but may place conditions on their use otherwise. The data policy for WMO recommended data encompasses the scope of the previous ones for WMO additional data and WMO other data. Reference: WMO Resolution 1 (https://library.wmo.int/records/item/58009-wmo-unified-data-policy)

Make the following codes "invalid"

WMOEssential, WMOAdditional, WMOOther

Comments

No response

Requestor(s)

@amilan17

Stakeholder(s)

WMO Secretariat. Applications using the WIGOS Codes. Members at large. OSCAR/Surface

Publication(s)

WMO Unified Data Policy as Resolution 1, Cg-Ext-2021 Manual on Codes (WMO-No. 306), Volume I.3, WMO Codes Registry, Code table 9-02, http://codes.wmo.int/wmdr/DataPolicy

Expected impact of change

MEDIUM (technically feasible, but requires an effort from existing metadata repositories). Applications like OSCAR/Surface and OSCAR/Space that document observations made by Members need to be aware that ongoing data series / observations can no longer be documented with data policies dating back to before Cg-Ext 2021. Thus, a change of data policy assignment needs to be made. For observations labeled as WMOEssential, the new term WMOCoreData may be applied. For observations labeled as either WMO Additional or WMOOther, the new term WMORecommendedData may be applied. For observations that were terminated before Resolution 1 became effective, no change is required.

Collaborators

No response

References

No response

Validation

No response

[joergklausen]

At first glance, this requires changes as follows:

addition: WMOCore, with updated definition WMORecommended, with updated definition

Open questions, with consequences on further amendments:

1. Can the existing element WMOEssential and WMOAdditional be superseded by WMOCore and WMORecommended?
2. Will there be a substitute for WMOOther, or should this remain?

Who decides? A priori, this is a high-level governance decision beyond the remit of TT-WIGOSMD.

[amilan17]

https://github.com/wmo-im/tt-wigosmd/wiki/2023.04.21-TT-WIGOSMD notes: (Joerg) - it's a high level decision to determine if old essential is now core. (John) It's definitely not our decision about what data is labeled core or recommended. We need to check with the authority (?) that the old values are definitely deprecated for legacy data. The definition of core observations will evolve. We should get feedback on the descriptions for old codes. This should go to the chairs of SC-ON.

[amilan17]

https://github.com/wmo-im/tt-wigosmd/wiki/2023.05.04-TT-WIGOSMD notes: @amilan17 will talk with Kruno first.

[amilan17]

https://github.com/wmo-im/tt-wigosmd/wiki/2023.06.01-TT-WIGOSMD/ notes: @amilan17 talking with Kruno next week; noting that WIS Metadata will also have a need to include data policy values in the WCMP2 metadata;

[amilan17]

@kpremec can you please let me know your thoughts on the questions below? I suspect that the answer is NO, we shouldn't assume that all datas using previous data policies will map cleanly to the Core and Recommended, but it would be good to know if there are other thoughts.

1. Should the existing code values WMOEssential and WMOAdditional be superseded by WMOCore and WMORecommended
2. Should WMOOther also be superseded by WMORecommended

[amilan17]

https://github.com/wmo-im/tt-wigosmd/wiki/2024.03.21%E2%80%90TT%E2%80%90WIGOSMD notes: Until further clarification, just add core and recommended to the list of data policy values. @joergklausen will work on this branch

[joergklausen]

Proposal updated and ready for review.

[amilan17]

For alignment with WCMP2 and WTH, I recommend just 'core' and 'recommended'

[amilan17]

https://github.com/wmo-im/tt-wigosmd/wiki/2024.04.09%E2%80%90TT%E2%80%90WIGOSMD notes:

• Joerg updated the proposal;
• @amilan17 review the definitions;
• @joergklausen use this link for the UDP: https://library.wmo.int/idurl/4/46772;
• there was a conversation about how to understand what is listed as core data fro the UDP;
• John noted that the mechanism for updating the annex is through INFCOM (instead of Congress as before);

[amilan17]

to do: add new terms, deprecate old terms in branch

[amilan17]

https://github.com/wmo-im/tt-wigosmd/wiki/2024.05.16%E2%80%90TT%E2%80%90WIGOSMD notes: Franziska agrees that the previous terms can be deprecated and/or blocked from new additions (TBD), but this does not prevent the proposal moving forward.

[amilan17]

@joergklausen I updated the branch. Will you please review it?

[amilan17]

2024-08-08 notes from ET-WOT: ok with adding new codes (core and recommended). Deprecation/retirement of the older values may need to go through a different approval process than fast-track.

[amilan17]

Add the following (don't delete the previous values).	notation	name	description
WMOCore	WMOCore	"Earth system data that are necessary for the provision of services in support of the protection of life and property and for the well-being of all nations, at a minimum those data described in Annex 1 of the Unified Data Policy, which are required to monitor and predict seamlessly and accurately weather, climate, water and related environmental conditions. WMO Members shall provide core data on a free and unrestricted basis. The data policy for WMO core data is similar in scope to the previous one for WMO essential data. Reference: Resolution 1 (Cg-Ext(2021)) – WMO Unified Policy for the International Exchange of Earth System Data (World Meteorological Congress: Abridged Final Report of the Extraordinary Session (WMO-No. 1281))."
WMORecommended	WMORecommended	"Earth system data that are required to support Earth system monitoring and prediction activities at the global, regional and national levels and to further assist other WMO Members with the provision of weather, climate, water and related environmental services in their States and Territories. WMO Members should provide access to all recommended data exchanged under the auspices of WMO without charge to public research and education communities for their non-commercial activities, but may place conditions on their use otherwise. The data policy for WMO recommended data encompasses the scope of the previous ones for WMO additional data and WMO other data. Reference: Resolution 1 (Cg-Ext(2021)) – WMO Unified Policy for the International Exchange of Earth System Data (World Meteorological Congress: Abridged Final Report of the Extraordinary Session (WMO-No. 1281))."

[amilan17]

Final proposal:

1. don't deprecate WMOEssential, WMOAdditional and WMOAdditional
2. change WMORecommended to recommended and WMOCore to core to align with the WIS codes for the WMO data policy. (see http://codes.wmo.int/wis/topic-hierarchy/data-policy)

[amilan17]

feedback from ET-WTR for OSCAR/Surface: Option 3: Keep old entries (deprecated) but also add/migrate to new ones

• definition of criteria for standard migration, consultation and migration needed; If this becomes a search criteria, old entries should be available as well in the search.