This repository contains the web scraper utilities to scrape the data (course, major, minor, HASS, etc.) from various RPI webpages and compile it into a useful format.
Make sure you have python and pip installed first before running the following.
git clone git@github.com:rpi-crisis/scraper.git
cd scraper/
python -m venv venv
. ./venv/bin/activate
pip install -r requirements.txt
To run the course scraper:
python src/course.py