Add Spatial Hub as a data source

[JackGilmore]

Add https://data.spatialhub.scot/dataset/ as a source

We think this might be possibly through the existing CKAN API.

Some datasets on the Spatial Hub are already published by local authorities in their individual open data portals which has the potential to cause duplicates. For example, Angus Council’s polling districts is listed on both their CKAN instance, and IS’s Spatial Hub. We need to have a discussion around how we tackle these instances.

• Do we consider them duplicates?
• Do we add both records to the site or do we just add one of them?
• If the latter option, which ones goes on the site?

Out of the 138 datasets on the Spatial Hub, 42 of them are licensed as “not open”, meaning it would potentially be counterproductive to list them on opendata.scot as they would be inaccessible to the vast majority of people. We need to have a discussion around this and decide whether we list these datasets regardless of license or if we filter down to datasets only with an open license. If the latter option was chosen then we would need to do some work on filtering these non-open datasets by adding a new step to our pipeline.

[watty62]

Looking at Open Data only on the Spatial Hub, we have for example

• East Lothian with 4 data sets.
• East Renfrewshire - 3 datasets
• Falkirk - 1 datasets
• Fife - 3 datasets
• Inverclyde - 3 datasets
• Scottish Borders - 3 datasets
• Shetland - 3 datasets
• South Lanarkshire - 3 datasets
• West Dunbartonshire - 3 datasets
• West Lothian - 4 datasets
• Western Isles - inconsistent gaelic naming - 3 datasets

This would fix 11 of the 14 of the missing councils in issue 68 - although there may be other sources (eg see Fife on that issue).

[whensman]

@watty62 There should be at least 3 open data datasets from each LA (except Falkirk). Some (not listed above) are not available anywhere else (e.g. Clacks)