stumash / CoursePlanner

http://conucourseplanner.online
MIT License
5 stars 3 forks source link

course scraper to handle ORs in prerequisite lists for courses #63

Closed stumash closed 7 years ago

stumash commented 7 years ago

Right now, scrape-course-data.r is parsing the prerequisites of each course directly as the literal string of text from the webpages it visits. We are then storing that string as the prereq.string property of the JSON that goes into our db. For example we store some course's prereqs as the string COMP 201; COMP 233 or COMP 244; However we would like to store it as a JSON array-of-arrays. For the example I just used we want it to look like

[
    [
        "COMP 201"
    ],
    [
        "COMP 233",
        "COMP 244" 
    ]
]

This will allow us to implement course sequence validation logic on the backend and custom formatting of a course's prerequisites on the frontend.

stumash commented 7 years ago

development started on branch scraperSpacesAndPrereqOrs-47-63