search

Queens-Hacks / qcumber-scraper

Scrapes SOLUS and generates structured data
3 stars 6 forks source link

MATH 121A and B showing TBAs #27

Closed ChrisCooper closed 9 years ago

ChrisCooper commented 9 years ago

http://new.qcumber.ca/catalog/MATH/121A

Reported by Prof. Tennent

Graham42 commented 9 years ago

Just did a scrape and they're still TBA, double checked and that's the info that's available on SOLUS by clicking through the course catalogue. Fun fact though, if you search for Mathematics and 'contains' 121, it gives you 3 sections that aren't otherwise listed.

I'd recommend we rename this issue to be something about incomplete data with current scraping method.

pR0Ps commented 9 years ago

Closing this as per @graham42 's comment. We can open another issue for the search scraping, but I suspect we won't do anything about it, scraping via search was looked into before and rejected. We can manually change the broken sections and notify SOLUS of the issue.

ChrisCooper commented 9 years ago

Sorry, I didn't actually check when he sent me the info (I should have remembered this issue). But currently I'm seeing things we don't have, even on the course catalog section. Here's a screenshot from right now on the MATH 121A page:

screenshot from 2014-12-23 16 32 59

So this is a real scraper bug? Or is this new info on SOLUS in the last 36 hours? (Also possible at this time of year)