scrapy-plugins / scrapy-splash

Scrapy+Splash for JavaScript integration
BSD 3-Clause "New" or "Revised" License
3.15k stars 450 forks source link

how to set splash timeout #123

Closed JhonSmith0x7b closed 7 years ago

JhonSmith0x7b commented 7 years ago

I run a splash server in the docker. commond: docker run -p 8050:8050 scrapinghub/splash --max-timeout 3600 But I got a 504 error. "error": {"info": {"timeout": 30}, "description": "Timeout exceeded rendering page", "error": 504, "type": "GlobalTimeoutError"}

Although I try to add splash.resource_timeout, request:set_timeout and SPLASH_URL = 'http://localhost:8050?timeout=1800.0', nothing changed. Thanks for help.

kmike commented 7 years ago

The intended way is to use SplashRequest(url, self.parse, args={'timeout': 1800, ...}) - does it work for you?

JhonSmith0x7b commented 7 years ago

@kmike Yes, thank u!

vionemc commented 6 years ago

It doesn't work for me. I got error 400

yeszao commented 5 years ago

@vionemc The max value of timeout is 90, here is the doc: https://splash.readthedocs.io/en/stable/api.html#render-html