Open phuchonguyen opened 6 years ago
After my Scrapy spider crawls the web for a while, I would get one of the following errors:
Or the server would die with this error:
After I restart the server, the spider will work again for a while before a similar error pops up again. I've tried increasing the timeout limit but that didn't help.
any news on this?
Is there any solution for this?
I have also this issue it seems
After my Scrapy spider crawls the web for a while, I would get one of the following errors:
Or the server would die with this error:
After I restart the server, the spider will work again for a while before a similar error pops up again. I've tried increasing the timeout limit but that didn't help.