We have many scrapers which will run as azure function (scheduled) . We need to decide which scraper to run when , because
if they all run at the same time , it can bring down the mongoDB cluster
We need to make sure that the bigger ones are not run simultaneously
We have many scrapers which will run as azure function (scheduled) . We need to decide which scraper to run when , because if they all run at the same time , it can bring down the mongoDB cluster
We need to make sure that the bigger ones are not run simultaneously