This PR fixes a bug in the Makefile that caused the start time to be calculated at the start of every subdivision scrape rather than at the start of the Makefile run. I also opted to use the CloseSpider exception to end scrapers that hit the time limit.
This PR fixes a bug in the Makefile that caused the start time to be calculated at the start of every subdivision scrape rather than at the start of the Makefile run. I also opted to use the
CloseSpider
exception to end scrapers that hit the time limit.Part of #59