search

SpiderClub / haipproxy

:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
https://spiderclub.github.io/haipproxy/
MIT License
5.43k stars 914 forks source link

安装都成功，但是一个IP都跑不到；有人碰见么 #71

Closed ap1024 closed 6 years ago

ap1024 commented 6 years ago

image

2018-09-05 10:29:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) Read 0 requests from haipproxy:spider:common 2018-09-05 10:29:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) Read 0 requests from haipproxy:spider:ajax Read 0 requests from haipproxy:spider:common Read 0 requests from haipproxy:spider:ajax Read 0 requests from haipproxy:spider:common Read 0 requests from haipproxy:spider:ajax Read 0 requests from haipproxy:spider:common Read 0 requests from haipproxy:spider:ajax

ResolveWang commented 6 years ago

你没启动定时任务调度器吧

ap1024 commented 6 years ago

要必须启动定时任务才能抓取到？ image 我只执行了这两个。

ResolveWang commented 6 years ago

文档写得很清楚啊

启动调度器，包括代理IP定时调度和校验

python scheduler_booter.py --usage crawler

python scheduler_booter.py --usage validator