Automating pulling of prereq data

[steventango]

I recently updated the steventango/synapse repo with a Github action to automatically scrape the prereq data weekly. I also added descriptions which are used by this bot.

I'd recommend pulling the file from https://raw.githubusercontent.com/steventango/synapse/main/data/ualberta.ca.json on deploy/weekly so the data does not become stale.

[Sooraj-beep]

@steventango does it only update prereq data or even desc and added/removed courses too?

[steventango]

Everything, it just scrapes every Sunday.

[Sooraj-beep]

The email you have used in your github action looks interesting. Can you explain whats going on there or point me to where I can read more about it?

git config --global user.email '18170455+steventango@users.noreply.github.com'

[Sooraj-beep]

Oh I see how it works, apparently github automatically hides it if you set the option. For anyone interested here's the link: https://docs.github.com/en/account-and-profile/setting-up-and-managing-your-personal-account-on-github/managing-email-preferences/setting-your-commit-email-address

It is most likely set by default.

[steventango]

I just recalled that my ualberta.ca.json is missing the "faculty" currently in your file, I can add it later today.