open-sdg / sdg-build

Python package to convert SDG-related data and metadata between formats
MIT License
6 stars 22 forks source link

SDMX API Dataflow version is no longer available #291

Closed LucyGwilliamAdmin closed 2 years ago

LucyGwilliamAdmin commented 2 years ago

@brockfanning Currently for the UN SDMX API input, we are pointing at v1.3 of the SDG Dataflow: https://github.com/open-sdg/sdg-build/blob/1.8.0-dev/sdg/inputs/InputSdmxMl_UnitedNationsApi.py#L54

However, that is no longer available: https://data.un.org/ws/rest/data/IAEG-SDGs,DF_SDG_GLH,1.3

We need to update the version (to 1.7?)

This is also something we need to check and implement each version unless there is a way to point at latest version?

brockfanning commented 2 years ago

According to the manual we should be able to use "defaults":

The full identify of the dataflow is built with maintenance agency ID, dataflow ID, and version, such as IAEG-SDGs,DF_SDG_GLH,1.1. However, the agency ID and version can be defaulted and only the dataflow ID can be used.

Though I'm trying to load that in the browser and it's just spinning. I think we'll need to investigate more.

LucyGwilliamAdmin commented 2 years ago

@brockfanning I was also getting the same earlier when I was trying to load 1.7 in the browser but I just had a thought - it might be because it's trying to load so much data as there's no further queries so I just tried the following in the browser and seems to work for me:

https://data.un.org/ws/rest/data/IAEG-SDGs,DF_SDG_GLH/...826+827+828+829.........../ALL/?detail=full&dimensionAtObservation=TIME_PERIOD (all series for UK)

brockfanning commented 2 years ago

Ah, good news, that makes sense. So then I think we can just remove the version number like in your example above?

LucyGwilliamAdmin commented 2 years ago

Yeah, I think that makes sense