search

WayneRose-95 / Metacritic_Webscraper-

A side project on creating my own first web scraper.
GNU General Public License v3.0
0 stars 0 forks source link

Feb 22 page switching fix #10

Closed WayneRose-95 closed 2 years ago

WayneRose-95 commented 2 years ago

Latest version fixes the page switching bug and the timeout exception issues.

However, further testing is required for the methods.

Next steps:

  1. Clean up the code. Remove unnecessary methods to the sample_scraper method
  2. Create unittest suite; testing all of the methods for the project so far.
  3. Implement headless mode into the main class to optimise processing time.