Filter which times series to add to the netcdf files

metno / S-ENDA-documentation

Temporary documentation and use case descriptions for the S-ENDA project - when concepts are tested and verified, content is gradually moved to more long term solutions.

https://s-enda-documentation.readthedocs.io/

2 stars 6 forks source link

Filter which times series to add to the netcdf files #290

Closed ElodieFZ closed 2 years ago

ElodieFZ commented 2 years ago

Until now, we have worked with all the raw data in ODA (kvkafka label). So for example, for Blindern, we have four different datasets for the air_temperature at 2m, as there are four temperature sensors at the station.

We should only publish the default time-series when several time-series are available for the same parameters. It should be possible to discriminate between these timeseries when the new Frost (v1) is available.

ElodieFZ commented 2 years ago

Make sure we document where the data comes from if we end up using an aggregated time-series, using provenance or history.

ElodieFZ commented 2 years ago

We request the default time-series only (so only one dataset per parameter/station) requesting these endpoints:

for frost v0 https://frost.met.no/observations/v0.jsonld
for frost v1 https://frost-staging.met.no/api/v1/obs/met.no/filter