search

Queens-Hacks / qcumber-scraper

Scrapes SOLUS and generates structured data
3 stars 6 forks source link

Current version does not scrape MATH 121 #25

Closed jpittis closed 9 years ago

jpittis commented 9 years ago

Math 121 IS on the course catalog! Not just through search.

pR0Ps commented 9 years ago

MATH 121, 121A, and 121B all exist, they're just further down the page because they're classified as a distance studies course (not undergraduate).

Subject: http://qcumber.ca/catalog/MATH http://new.qcumber.ca/catalog/MATH

Course: http://qcumber.ca/catalog/MATH/121/ http://new.qcumber.ca/catalog/MATH/121

jpittis commented 9 years ago

would it be worth reorganizing that in some way? To avoid people searching for it and not not finding it? I guess that's a front end issue.

pR0Ps commented 9 years ago

Yep, that would be a frontend thing. Feel free to create an issue on the qcumber-frontend project.

mystor commented 9 years ago

I've made some modifications to new.qcumber.ca which should make it easier to find courses which are classified as distance. However, it's not perfect. For example, http://new.qcumber.ca/catalog/MATH/121A only contains distance sections, which, admittedly, is what (unfortunately) the course catalog on SOLUS says. However, there are sections being offered on campus.

It would be really nice if we could somehow scrape the search functionality, because it tends to be much more accurate, but that sounds extremely difficult to do due to the way search is implemented.