Closed January closed 8 months ago
Part of why the webscraper was so slow was that it was initializing a new instance of Selenium for every page it needed to scrape. I changed it so that it's only initialized once, making the webscraper several times faster.
Part of why the webscraper was so slow was that it was initializing a new instance of Selenium for every page it needed to scrape. I changed it so that it's only initialized once, making the webscraper several times faster.