It happens sometimes that execute_spiders.py --update takes more than 24 hours to run. This is problematic because there would be two daily cronjobs running at the same time. Also it seems strange that merely updating snapshots would take that long, even if update scraper is not running in parallel.
It happens sometimes that
execute_spiders.py --updatetakes more than 24 hours to run. This is problematic because there would be two daily cronjobs running at the same time. Also it seems strange that merely updating snapshots would take that long, even if update scraper is not running in parallel.