search

UTDNebula / skedge

MIT License
8 stars 7 forks source link

Bugfix: RMP scraping #47

Closed iamwood closed 10 months ago

iamwood commented 10 months ago

There have recently been some changes to how RMP's professor searching works, which means the scraping to get information like their RMP score, Difficulty rating, and Would Take Again percentage are not being properly retrieved.

In order to fix this, investigate how the URL for searching professors changes (such as this link for the search of John Cole at UTD) and how the HTML returned is formatted so that the information we need can be extracted.

iamwood commented 10 months ago

This issue has actually been addressed in the develop branch, just not yet merged into the main branch. The scraper changes to account for the RMP change aught to be looked at to account for the same problem in Trends.