ryanhugh / searchneu

Search over Classes, Professors and Employees at NEU!
https://searchneu.com
GNU Affero General Public License v3.0
74 stars 18 forks source link

Lets dynamically update the site when the new semesters are added #36

Open ryanhugh opened 6 years ago

ryanhugh commented 6 years ago

Lets add support for all the terms that are being scraped from Northeastern's site! Right now the scrapers will dynamically scrape all the terms that finish after four months before now. However, these terms are still hardcoded into Home.js (in the frontend) and server.js (in the backend). In both of these spots, it would be possible to pull this information in dynamically. Lets change it so we don't have to manually update the site every semester!

One idea I had on how to do this would be to package this information into the JS when the JS is being built to avoid another round trip to the server that would be amazing. I think we should be able to do that on Travis, when the JS is built.

We can also make another endpoint on the server to return the list of all current terms (or program this another way - I just want to avoid another sequential round trip to the server).