search

GSS-Cogs / metadata-indexer

The metadata indexer will provide services to catalogue statistical publications from across government and surface in a centralised database.
Apache License 2.0
0 stars 0 forks source link

SDG scraper required #3

Open mikeAdamss opened 3 years ago

mikeAdamss commented 3 years ago

The upcoming climate change works needs a SDG scraper.

All SDG sources come from static files hosted on githb. This repo: https://github.com/ONSdigital/sdg-data and inside the /data and /meta directories.

An example url we need to scrape is: https://sustainabledevelopment-uk.github.io/13-1-1

We should be able to pull what we need straight from the github repo easy enough and avoid the html parsing.