SpiderClub weibospider issues

SpiderClub / weibospider

:zap: A distributed crawler for weibo, building with celery and requests.

MIT License

4.81k stars 1.21k forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

运行 python3 config/create_all.py 报错

#218 Shallowhave closed 1 year ago
6
运行python config/create_all.py 报错

#217 Shallowhave closed 2 years ago
1
requirements.txt 文件当中的requests、Django版本号请进行修改下，谢谢

#216 tianshanzhilong opened 3 years ago
0
关于更新/维护

#215 zjyzh opened 3 years ago
0
请问这个爬虫爬取关键词的话是只能爬取50页的上限吗？

#214 SinruW closed 3 years ago
1
微博爬虫的合理阈值

#213 chenyinghong opened 3 years ago
0
非酋做配置，试错笔记

#212 JeanYoung5 opened 3 years ago
2
爬取不到数据，启动 work 页面输出的都是一些爬取失败和 warning 信息类似：

#211 gaoshangle opened 4 years ago
1
登入帐号时遇到要求扫码登入，是Weibo有改版吗？

#210 leo1357904 opened 4 years ago
2
Use is_alive in favour of isAlive for Python 3.9 compatibility.

#209 tirkarthi opened 4 years ago
1
threading.Thread.isAlive has been deprecated and removed in Python 3.9 in favour of is_alive

#208 tirkarthi opened 4 years ago
0
云打码平台好像失效了，之前那个超级鹰平台的issues下的temp_verification我按照操作来可是出了奇怪的bug，请问能根据新的打码平台更新一下吗，麻烦了

#207 zjyzh closed 4 years ago
9
运行worker 就报错了，我的redie 配置和爬虫配置密码都对的:[2020-04-25 19:53:50,902: ERROR/MainProcess] consumer: Cannot connect to redis://:**@localhost:6379/6: Client sent AUTH, but no password is set.

#206 uyplayer closed 4 years ago
0
执行login_first.py之后显示ValueError: not enough values to unpack (expected 3, got 0)

#205 keithkang1986 closed 4 years ago
1
启动worker时执行到**[2020-04-02 12:36:58,850: INFO/MainProcess] mingle: all alone**就不再继续

#204 keithkang1986 opened 4 years ago
2
无法启动worker （停在INFO/MainProcess] mingle: all alone不动）

#203 keithkang1986 closed 4 years ago
0
抓取 user_relation。 user.py 有bug

#202 myrainbowandsky closed 4 years ago
0
user.py 中 script.string 有bug 导致 mysql数据库表user_relation一直是空

#201 myrainbowandsky opened 4 years ago
0
微博关键词搜索 create_time 一栏有四种时间格式，能否统一为一个 20**年**月**日的形式？

#200 myrainbowandsky closed 4 years ago
3
mysql数据库里user_relation这样表一直是空，是哪里有问题？

#199 myrainbowandsky closed 4 years ago
16
如何限定时间段，爬取从某年月日到某年月日的微博？

#198 myrainbowandsky closed 4 years ago
3
在UI界面增加新关键词以后，设置，是否启用为“1”，但是还是无法抓取新增加的关键词，老关键词，是否使用设置为“0”，显示的仍然是老关键词

#197 myrainbowandsky closed 4 years ago
0
爬关键词搜索失败

#196 xwt0016 closed 4 years ago
8
请问repost_crawler抓取的数据意义

#195 myrainbowandsky closed 4 years ago
1
datetime for repost_time

#194 thekingofcity opened 4 years ago
1
微博不显示等级

#193 thekingofcity opened 4 years ago
2
请问如何添加代理池？

#192 myrainbowandsky opened 4 years ago
2
能否用多线程代替多台机器来爬取？

#191 myrainbowandsky closed 4 years ago
1
无法看见转推信息；评论，点赞，回复数等也是0

#190 myrainbowandsky opened 4 years ago
6
如何在一台机器上同时搜索多个关键词？

#189 myrainbowandsky opened 4 years ago
2
请问可以抓到多久之前的围脖

#188 myrainbowandsky closed 4 years ago
3
请问如何验证程序在抓取数据了

#187 myrainbowandsky closed 4 years ago
0
Redis transport requires redis-py versions 3.2.0 or later. You have 2.10.5

#186 myrainbowandsky closed 4 years ago
0
无法用python config/create_all.py 制表

#185 myrainbowandsky closed 4 years ago
0
能不能用mongo而不用mysql？

#184 myrainbowandsky closed 4 years ago
3
安装依赖lib的时候 celery==4.1.0报错

#183 logie closed 4 years ago
4
【关于云打码】目前看来是失效了，近期我会针对这块做个兼容。

#182 OneCodeMonkey closed 4 years ago
2
云打码是不是凉了

#181 xwt0016 closed 4 years ago
13
不设置邮箱可以么？邮箱那部分不知道怎么设置，看不太懂。

#180 mengguiyouziyi closed 4 years ago
2
根据说明文档执行，这个程序运行不了

#179 GXNU156489 closed 4 years ago
4
fix

#178 OneCodeMonkey closed 4 years ago
0
Fix crawl comment

#177 OneCodeMonkey closed 4 years ago
0
worker启动后会自动的退出

#176 holoodst closed 4 years ago
2
在哪新建weibo数据库？

#175 fcrw closed 4 years ago
0
Fix crawl follows and fans

#174 OneCodeMonkey closed 4 years ago
0
fix crawl mode: accurate，修复“展开全文”404 获取不到内容的问题

#173 OneCodeMonkey closed 5 years ago
1
数据分享请求

#172 ashin010 closed 5 years ago
0
安装后台报错： mysqlclient 1.3.13 or newer is required; you have 0.7.11.None.

#171 OneCodeMonkey closed 5 years ago
1
全部按正常流程进行的，最后启动worker命令失败，输出日志如下

#170 OneCodeMonkey closed 5 years ago
2
为啥我的 celery 启动worker 正常成功了，用flower查看是确显示 offline，而且执行 python user_first.py 等等也没爬到信息？

#169 OneCodeMonkey closed 5 years ago
0