Aqua-Dream Tieba_Spider issues

Aqua-Dream / Tieba_Spider

百度贴吧爬虫(基于scrapy和mysql)

397 stars 116 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

改了add_argument函数，还是运行不了

#45 huanger-8 opened 1 year ago
1
抓取数据量比较大的贴吧时，抓取到36页的时候，报错了

#44 zhoululu closed 1 year ago
1
抓取第一个吧（仙五前修改吧）的数据正常，抓取第二个吧数据的时候就失败了

#43 zhoululu opened 1 year ago
0
看不出什么问题了，help

#42 woody3rd opened 2 years ago
1
请问怎么加代理

#41 codinghahaha closed 2 years ago
1
302验证问题

#40 almost-zhengming closed 2 years ago
2
哥又遇到问题了，大的贴吧帖子多爬到pn值10000以上，帖子开始一种循环，那些老帖是没了吗

#39 tomyu168 closed 3 years ago
2
被验证码卡住了

#38 qinglu008 closed 3 years ago
1
新手第一天用python，依赖的包都下载好了，运行scrapy run 沙发 aa

#37 tomyu168 opened 3 years ago
22
中途断了爬取怎样才能继续运行呢

#36 xiaolele1314 closed 3 years ago
1
AttributeError: 'list' object has no attribute 'values'求解答大佬

#35 DeakosS closed 3 years ago
0
mysqldb运行出错，MySQLdb 是python2用的？

#34 polgry closed 3 years ago
3
是否可以添加“从什么时候的帖子开始爬”

#33 fgott closed 3 years ago
1
AttributeError: 'Values' object has no attribute 'overwrite_output'

#32 jjshare opened 3 years ago
12
启动报错

#31 0x9bb1 closed 3 years ago
1
我在运行项目时出现了问题

#30 shenyi1 closed 3 years ago
1
请问这个是被block了吗？

#29 kajweb closed 4 years ago
11
scrapy新版本make_requests_from_url method被弃用，代码运行不了

#28 zhangbige closed 4 years ago
0
添加cookie

#27 Aqua-Dream opened 4 years ago
4
HI 请问被百度封ip怎么办

#26 xsxs89757 closed 4 years ago
1
有两个问题向您请教

#25 Kongwhei closed 4 years ago
2
爬虫爬出来 500 Internal Server Error

#24 yyc12345 closed 4 years ago
2
AttributeError: module 'config' has no attribute 'config'

#23 nolczak closed 4 years ago
2
关于win10上的使用？

#22 barnett2010 closed 4 years ago
5
添加mysql port

#21 sumrise closed 4 years ago
0
http://tieba.baidu.com/p/5069506634 无法爬到

#20 CharrzookA closed 4 years ago
3
运行过程中报错 ERROR: Spider error processing

#19 iseesaw closed 4 years ago
3
可以把三张表的内容合在一起吗，我想直接入kafka

#18 ZQbd closed 5 years ago
6
Hi 请问怎么添加 UA，因为需要拿到 contents 里面的音频内容，如果是电脑浏览器的话，不会包含

#17 YunyueLin opened 5 years ago
3
同一份代码，在本地运行爬取很快，放到腾讯云上就很慢，有人遇到同样的问题吗？

#16 shimachao closed 5 years ago
0
在哪里设UA，具体设成什么，重定向的地址是什么，~~我一问三不知~~

#15 shimachao closed 5 years ago
1
请教一下大佬，为啥自己设置了user-agent就爬取不到数据了

#14 shimachao closed 5 years ago
1
为什么爬取数据的时候，内存占用会越来越大呢？应该要怎么优化？

#13 LCG22 closed 5 years ago
7
爬取时出现了AttributeError: 'list' object has no attribute 'values'.

#12 Nekofish-L closed 5 years ago
4
能不能搞一个删除自己发的帖子的功能啊

#11 vinceok closed 5 years ago
1
在运行scrapy爬取信息时报错ERROR: Spider error processing 跪求大佬解答

#10 Thomas-YXW closed 5 years ago
5
楼中楼的没爬全

#9 Tangzy7 closed 4 years ago
11
百度贴吧帖子数据排序跟爬到的数据不一致

#8 hjlFrist closed 5 years ago
2
你这个好多包没有更新？

#7 hjlFrist closed 5 years ago
1
你好，我运行程序出现错误请求帮助。

#6 Systempm closed 6 years ago
13
mac + anaconda 配置环境和执行

#5 congcong009 closed 6 years ago
7
mysql 插入错误

#4 ZORQBPJHz closed 6 years ago
3
should check for date not time, typo

#3 pettersoderlund closed 6 years ago
1
运行Tieba_Spider提示如下错误，一直解决不了，请帮忙看看原因，谢谢！

#2 kitty7angela closed 7 years ago
2
mysql boom了

#1 tetsaicn closed 7 years ago
9