scrapy-plugins / scrapy-splash

Scrapy+Splash for JavaScript integration
BSD 3-Clause "New" or "Revised" License
3.15k stars 450 forks source link

No results at "Server listening on http://0.0.0.0:8050" #248

Closed mgrazianoc closed 4 years ago

mgrazianoc commented 4 years ago

I'm on Windows using Docker tool box.

When I run docker run -it -p 8050:8050 --rm scrapinghub/splash, I receive the message Server listening on http://0.0.0.0:8050,as it should be. But when I go to the address, the only thing that returns is ERR_ADDRESS_INVALID, the page isn't loading.

I try to search for this problem, changing the SPLASH_URL on my settings.py according to my Docker IP adress, but still with no sucess. The reason I'm intereseting in fixing this issue on my machine is because when I crawl with my spider, it just does nothing, i.e., the logging info returns:

[scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)

Any ideias on how I messed this up? Thanks!

mgrazianoc commented 4 years ago

I've managed to understand the problem.

I have to change my SPLASH_URL to my docker-engine ip. I didn't help-me me with the logging problem, but at least helped me to uderstand the causes from the ERR_ADDRESS_INVALID. Now I can debbug my code knowing that Scrappy is running perfectly normal.

StackOverflow helped me resolving this issue.

mgrazianoc commented 4 years ago

I also resolve the problem in the log message. I was calling my fuction as start_request, when I should use start_requests, at plural.

Gallaecio commented 4 years ago

Shall we close this issue, then?

mgrazianoc commented 4 years ago

Yes