ministryofjustice / data-and-analytics-engineering

Handbook for the data and analytics engineering professions
https://ministryofjustice.github.io/data-and-analytics-engineering/
MIT License
2 stars 2 forks source link

extract and publish rfc discussions #46

Closed SoumayaMauthoorMOJ closed 1 month ago

SoumayaMauthoorMOJ commented 1 month ago

Add a bash script scrape_github.sh to extract GitHub discussions from named repositories with the label RFCs and write the details to markdown files to a new collection, similar to the blog posts collection.

image

The bash script should be updated to specify the RFC category as part of the API call, and get rid of filtering by RFC label.

To run scrape_github.sh locally you'll need to save a GitHub secret with permission to read discussions from the relevant repos to a .env file.