OpenDataScotland / the_od_bods

Collating open data from across Scotland
MIT License
21 stars 18 forks source link

Add Spatial Hub as a data source #97

Closed JackGilmore closed 2 years ago

JackGilmore commented 2 years ago

Add https://data.spatialhub.scot/dataset/ as a source

We think this might be possibly through the existing CKAN API.

Some datasets on the Spatial Hub are already published by local authorities in their individual open data portals which has the potential to cause duplicates. For example, Angus Council’s polling districts is listed on both their CKAN instance, and IS’s Spatial Hub. We need to have a discussion around how we tackle these instances.

Out of the 138 datasets on the Spatial Hub, 42 of them are licensed as “not open”, meaning it would potentially be counterproductive to list them on opendata.scot as they would be inaccessible to the vast majority of people. We need to have a discussion around this and decide whether we list these datasets regardless of license or if we filter down to datasets only with an open license. If the latter option was chosen then we would need to do some work on filtering these non-open datasets by adding a new step to our pipeline.

watty62 commented 2 years ago

Looking at Open Data only on the Spatial Hub, we have for example

This would fix 11 of the 14 of the missing councils in issue 68 - although there may be other sources (eg see Fife on that issue).

whensman commented 2 years ago

@watty62 There should be at least 3 open data datasets from each LA (except Falkirk). Some (not listed above) are not available anywhere else (e.g. Clacks)