Global Monitor requirements on Global Discovery Catalogue

[tomkralidis]

What metrics will the Global Monitor collect/report on w.r.t. the GDC? At the moment we can provide KPI reporting based on pywcmp, which provides a (JSON) report of how a WCMP2 record scores against the KPI matrix. As well, the result of #10 may also provide valuable GDC metrics.

cc @elgarraichemseddine @kaiwirt @golfvert

[kaiwirt]

@tomkralidis You can add your proposed metrics here https://github.com/wmo-im/wis2-metric-hierarchy/tree/main/metric-hierarchy

I think the KPI's would be valuable as well as the number of metadata and maybe the update frequency.

[tomkralidis]

TT-WISMD 2023-09-13:

• GDC reports (monthly)
  • metadata
  • pass/fail by centre
  • KPI results by centre
    • overall number by centre
    • score/grade per document per centre
    • documents per centre/country
    • documents per Earth system discipline
  • API
  • most popular search terms
  • number of core / recommended datasets
  • number of requests

[tomkralidis]

cc @antje-s

[antje-s]

Added a first proposal https://github.com/wmo-im/wis2-metric-hierarchy/blob/main/metric-hierarchy/gdc.csv Currently used:

• percentage instead of grade/score (easy to understand and compare)
• no total number, since this corresponds to the sum of core + recommended or passed + failed Not yet included:
• KPI - documents per Earth system discipline Perhaps more relevant total number of metadata records per Earth system discipline instead of KPI value?

[tomkralidis]

TT-WISMD 2023-10-06:

• @antje-s to provide example OpenMetrics payload (open new issue RE: metrics requirements for GDCs)

[antje-s]

• Some general information about openmetrics can be found at https://github.com/OpenObservability/OpenMetrics/blob/main/specification/OpenMetrics.md
• Our GC metrics are one regular example, which can be accessed at https://opendata.dwd.de/test/wis2/cache/metrics/globalcache/gc_metrics.txt

Example: # HELP wmo_wis2_gc_downloaded Amount of downloaded file # TYPE wmo_wis2_gc_downloaded gauge wmo_wis2_gc_downloaded{centre_id="all",country="all",report_by="dwd"} 546701.0 wmo_wis2_gc_downloaded{centre_id="gts_to_wis2_dwd",country="xxg",report_by="dwd"} 0.0 wmo_wis2_gc_downloaded{centre_id="dwd",country="deu",report_by="dwd"} 357.0 wmo_wis2_gc_downloaded{centre_id="swic",country="xxg",report_by="dwd"} 38377.0 ...

Short description of the structure: # HELP my_description # TYPE metric_type my_metric_name{my_label1=label1_value,my_label2=label2_value} metric_value (Comment: Our values provided online also contain the timestamp of the metric value at the end of the line)

[tomkralidis]

@antje-s thanks; can you add a minimal example based on the proposed GDC metrics?

[antje-s]

e.g.

# HELP wmo_wis2_gdc_passed_total Number of metadata records passed validation
# TYPE wmo_wis2_gdc_passed_total gauge
wmo_wis2_gdc_passed_total{centre_id="dwd",report_by="ca-eccc-msc"} 4
wmo_wis2_gdc_passed_total{centre_id="eumetsat",report_by="ca-eccc-msc"} 5
...
# HELP wmo_wis2_gdc_failed_total Number of metadata records failed validation
# TYPE wmo_wis2_gdc_failed_total gauge
wmo_wis2_gdc_failed_total{centre_id="dwd",report_by="ca-eccc-msc"} 2
wmo_wis2_gdc_failed_total{centre_id="eumetsat",report_by="ca-eccc-msc"} 2
...

(one label for each center)