scrapinghub / splash

Lightweight, scriptable browser as a service with an HTTP API
BSD 3-Clause "New" or "Revised" License
4.09k stars 513 forks source link

Scrapy-splash: User timeout caused connection failure or 504 Gateway timeout #805

Open phuchonguyen opened 6 years ago

phuchonguyen commented 6 years ago

After my Scrapy spider crawls the web for a while, I would get one of the following errors:

Or the server would die with this error:

After I restart the server, the spider will work again for a while before a similar error pops up again. I've tried increasing the timeout limit but that didn't help.

psdon commented 3 years ago

any news on this?

okoliechykwuka commented 2 years ago

Is there any solution for this?

DGrv commented 7 months ago

I have also this issue it seems