Sprint 8/9: Scrape user reviews from Sprint

sydneyhill3901 / CSI2999

Project

MIT License

0 stars 0 forks source link

Sprint 8/9: Scrape user reviews from Sprint #141

Open mooremk95 opened 4 years ago

mooremk95 commented 4 years ago

Scrape user reviews from Sprint per the same metric used for best-buy. Also scrape the avg score. These will be stored in the database tables designed by Mike.

mooremk95 commented 4 years ago

Extended to Sprint 9. Reviews were hidden behind a JS event which prevented us from being able to scrape them via our usual method of requests combined with beautiful soup. Sydney is looking into use the requests-html library to simultaneousl execute this JS and parse the documents via one library.