Right now the scrapers just scrape everything from Northeastern's site. If a semester has already ended and all of the data from that semester already exists on Search NEU lets just re-use that data instead of scraping it all again. We should also add the ability to only scrape certain semesters through the API. This can be used as a part of Semester.ly's scraping (They have every semester to scrape hardcoded).
Right now the scrapers just scrape everything from Northeastern's site. If a semester has already ended and all of the data from that semester already exists on Search NEU lets just re-use that data instead of scraping it all again. We should also add the ability to only scrape certain semesters through the API. This can be used as a part of Semester.ly's scraping (They have every semester to scrape hardcoded).