OpenDataScotland / the_od_bods

Collating open data from across Scotland
MIT License
20 stars 18 forks source link

Scottish Parliament scraper script #252

Closed JackGilmore closed 1 year ago

JackGilmore commented 1 year ago

Description

Script to close #208 by scraping Scottish Parliament datasets Also includes some performance fixes for merge_data.py and some common json utilities for the main pipeline processor class

Motivation and Context

Add more data to site

How Has This Been Tested?

Ran script locally and then checked output in JKAN

Screenshots (if appropriate):

Types of changes

Checklist:

JackGilmore commented 1 year ago

merged_output_untidy.json change should purely be whitespace. I accidentally committed an update to it but have since reverted