search

laixin86714802 / spider-platform

可视化爬虫自动采集平台
174 stars 74 forks source link

请问一下这个怎么安装？ #1

Open ronghuaxueleng opened 6 years ago

ronghuaxueleng commented 6 years ago

请问一下这个怎么安装？

laixin86714802 commented 6 years ago

安装python3.4 cd ./spider-platform pip install -r requirement.txt -i https://pypi.douban.com/simple python server.py

luxux commented 6 years ago

但是在linux 下安装，怎么不能运行

laixin86714802 commented 6 years ago

当时在windows平台下开发 有的模块应该不适用于linux

GitMrs commented 6 years ago

启动时报这个错了，请问一下怎么解决？ File "server.py", line 50, in debug=False File "server.py", line 23, in setup_event_loop IOLoop.instance().set_blocking_log_threshold(0.5) File "C:\Users\Mr\AppData\Local\Programs\Python\Python36\lib\site-packages\tornado\ioloop.py", line 461, in set_blocking_log_threshold self.set_blocking_signal_threshold(seconds, self.log_stack) File "C:\Users\Mr\AppData\Local\Programs\Python\Python36\lib\site-packages\tornado\ioloop.py", line 446, in set_blocking_signal_threshold raise NotImplementedError() NotImplementedError

laixin86714802 commented 6 years ago

我用的python3.4，tornado==4.5.3 应该是版本问题

LenmonLin commented 5 years ago

请问，动态解析网页太慢, 资源占用过高的问题有解决思路吗

laixin86714802 commented 5 years ago

动态解析网页可以用selenium+chrome 不过和这个项目的设计不符 可以单独再写一个