search

UGA-ITOSHumanitarianGIS / CODV2API

COD Services for Common Operational Datasets used by Humanitarian Operations -API, Documentation, Progress and Issue tracking and Resources
Apache License 2.0
6 stars 0 forks source link

HDX Scraper outputs #14

Open UGA-ITOSHumanitarianGIS opened 2 years ago

UGA-ITOSHumanitarianGIS commented 2 years ago

another output was created to return all datasets

/api/v1/locations/pull

this output is designed to show locations (i.e) Ethiopia and the versions for that location and theme. So there may be more than one dataset returned with the associated resources by version.

This is being tested. HDX currently shows all resources regardless of version in one dataset per location as resources define the range of the dataset years and resources may have more than one version in a dataset. The COD Services API allows for versions of datasets as well, which allows for different sources and contributors or licensing or other elements to change among versions should there be additional resources for a dataset that do not match that of the existing COD metadata.

The additional output allows for this view representation to show in the output while retaining the /api/v1/locations/all to show the COD Services api datasets according to all resources versions to a location and theme.

UGA-ITOSHumanitarianGIS commented 2 years ago

The new output was implemented 31 Jan 2022

UGA-ITOSHumanitarianGIS commented 2 years ago

The hdxscraper output was updated so that resources from datasets modeled in the API as different versions of the same location are merged and the original dataset is retained.

UGA-ITOSHumanitarianGIS commented 2 years ago

Update production with scraper output union of resources of all datasets at a location for a theme to remove duplicates (EMF) files for example