stufraser1
commented
1 year ago In Short term, let's create metadata in RDL format and provide original URL. Longer term we could look to bring some data across but this is not urgent and would require agreement of each data provider.
From: Mattia Amadio @.> Sent: Monday, March 6, 2023 2:32:45 PM To: GFDRR/rdl-standard @.> Cc: Stuart Fraser @.>; Assign @.> Subject: [GFDRR/rdl-standard] Access to global datasets from 3rd parties (#31)
Overview
Global datasets are oftern the only source of data for country scale risk analysis in developing countries. GFDRR gets a lot of request for these kind of data to be used in projects. We need to address if and how these datasets are going to be accessed via RDL and its upcoming workflows.
Example data
Exposure:
- Worldpophttps://www.worldpop.org/project/categories?id=3
- Open Street Maphttps://wiki.openstreetmap.org/wiki/Databases_and_data_access_APIs
Hazard (see also sheethttps://worldbankgroup-my.sharepoint.com/:x:/g/personal/mamadio_worldbank_org1/EdmT0D0YD1BOqlBYOJNKiioBFsOmaC1mnzcGPPBSxzA5Zw?e=EdN7WZ)
- GAR17 hazardshttps://risk.preventionweb.net/capraviewer/
- IbTracshttps://www.ncei.noaa.gov/access/metadata/landing-page/bin/iso?id=gov.noaa.ncdc:C00834 (Cyclones)
- FWI (Wildfires)
- FAO-ASIhttp://www.fao.org/giews/earthobservation/asis/index_1.jsp?lang=en (Droughts)
- WRI Flood mapshttps://www.wri.org/data/aqueduct-floods-hazard-maps
Use cases
- Download data to use in GIS analytics
- Visualisation of map in GIS or WebGIS
- Processing in online analytical tools (e.g. clip to country extent, overlay with other data)
Options
Options for the inclusion of data have balanced pros and cons.
-
Include in the catalogue as metadata; download links points to original source (download page); link to API (data access) and WMS (data view) whenever available from source (e.g. OSM) (+) No storage used (+) Always up to date (new versions, etc) (-) TIed to original data format, which may not be optimal (in particular for any pre-set analytical tool) (-) Become inaccessible if source is discontinued
-
Include in the catalogue pointing to a copy of the data in the RDL storage (+) Reformat as optimal for workflow and alignment to schema (+) Access granted independently of source changes (-) Storage used (-) Need manual updating of versions
— Reply to this email directly, view it on GitHubhttps://github.com/GFDRR/rdl-standard/issues/31, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AC7PNYURPBC77DCEOPXWYZLW2XYQ3ANCNFSM6AAAAAAVRGNYZA. You are receiving this because you were assigned.Message ID: @.***>
pzwsk
Overview
Global datasets are oftern the only source of data for country scale risk analysis in developing countries. GFDRR gets a lot of request for these kind of data to be used in projects. We need to address if and how these datasets are going to be accessed via RDL and its upcoming workflows.
Example data
Exposure:
Hazard (see also sheet)
Use cases
Options
Options for the inclusion of data have balanced pros and cons.
1. Include in the catalogue as metadata; download links points to original source (download page); link to API (data access) and WMS (data view) whenever available from source (e.g. OSM) (+) No storage used (+) Always up to date (new versions, etc) (-) TIed to original data format, which may not be optimal (in particular for any pre-set analytical tool) (-) Become inaccessible if source is discontinued
2. Include in the catalogue pointing to a copy of the data in the RDL storage (+) Reformat as optimal for workflow and alignment to schema (+) Access granted independently of source changes (-) Storage used (-) Need manual updating of versions