Instead of defining search queries inside the scrape_and_send.py module, define them inside each scraper class. This way the scrapers can independently run for each website.
This will probably need the scrape() function to be changed to a generator function.
Instead of defining search queries inside the
scrape_and_send.py
module, define them inside each scraper class. This way the scrapers can independently run for each website.This will probably need the
scrape()
function to be changed to a generator function.