dataabc weibo-crawler issues

dataabc / weibo-crawler

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频

3.21k stars 734 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

不错。能下载全部的原创微博图片。

#447 zhanghengli1998 opened 1 hour ago
0
有办法突破专属会员鉴权吗

#446 frozenbeanxxx opened 1 day ago
1
运行之后总是显示config.json格式不正确

#445 Lzcns closed 1 week ago
2
微博爬取截止时间

#444 DoloresTu opened 1 month ago
2
无法爬取地区、学校、生日相关信息

#443 YiCheng996 opened 1 month ago
3
build(deps): bump pymysql from 1.1.0 to 1.1.1

#442 dependabot[bot] closed 1 month ago
0
build(deps): bump requests from 2.31.0 to 2.32.0

#441 dependabot[bot] closed 1 month ago
0
被ban了

#440 hyliush opened 1 month ago
1
write_post 增加POST写入方式

#439 myshero closed 2 months ago
1
build(deps): bump tqdm from 4.66.1 to 4.66.3

#438 dependabot[bot] closed 2 months ago
0
Docker 定时跑时，图片和视频是否是反复下载？

#436 niubird00 closed 2 months ago
0
sqlite储存数据非常大

#435 hibread opened 2 months ago
1
csv中抓取的用户头像链接有时候会失效怎么解决？

#434 gjxloveu opened 2 months ago
1
转发和评论好像出现了奇怪的问题

#433 gjxloveu opened 2 months ago
1
请问下载的评论在哪

#432 gjxloveu opened 2 months ago
1
怎么爬取用户的ip归属地呢？

#431 duhui123 opened 2 months ago
7
build(deps): bump pymongo from 4.6.1 to 4.6.3

#430 dependabot[bot] closed 2 months ago
0
“检测cookie是否有效”的功能失效

#429 Pangweiyun opened 3 months ago
2
爬取的图片名字里有一个奇怪的T

#428 Pangweiyun opened 3 months ago
1
当单个微博图片超过9张时，weibo-crawler只能下载9张

#427 Pangweiyun opened 3 months ago
2
COOKIES没有失效，但是Progress: 19%就结束了，可能是什么原因？

#426 wendywjhu opened 3 months ago
3
如何爬取微博正文时展开全文爬取到完整内容

#425 jingyoung115 opened 3 months ago
1
求助-爬微博进度100%，但是数量明显跟实际数量不一致有可能是何原因？

#424 wendywjhu closed 3 months ago
3
微博内容（Weibo.text）最大长度报错问题

#423 wendywjhu closed 3 months ago
1
某行是一条独立换行内容的时候这个换行最终读取到MYSQL会被省略掉

#422 wendywjhu opened 3 months ago
0
docker镜像

#421 JadePureOne opened 3 months ago
1
你好，我想下载所有微博正文，该怎么设置呢？

#420 copymonopoly opened 3 months ago
3
为什么按照你的文档配置还是不能写入MySQL数据库，按照之前的有错误的地方，我也添加

#419 markhome1 opened 3 months ago
3
Update README.md

#418 brian95827 closed 3 months ago
1
批量下载时，中间有提示错误，但是下载还是继续，其他微博的下载也正常

#417 wangshiyijiu opened 4 months ago
3
可不可以把爬取到的评论直接以csv的格式显示，不放在sqlte数据库里面

#416 linning00 opened 5 months ago
1
bug fix: csv header

#415 BlancRay closed 3 months ago
0
半年可见限制

#414 vanichocola opened 5 months ago
1
如果是长微博出现'全文'字样爬取不全

#413 HanchuQin closed 5 months ago
3
max_id_type错误

#412 haohaomiao opened 6 months ago
1
string indices must be integers, not 'str'

#411 nanamicat opened 7 months ago
3
修正一些无法运行的问题

#410 nanamicat closed 7 months ago
1
微博用户注册信息

#409 alewina opened 7 months ago
1
数据库表问题

#408 ElvisDream opened 7 months ago
1
数据库表问题

#407 ElvisDream closed 7 months ago
0
配置了数据库信息，但实际创建数据库连接报错

#406 ElvisDream opened 7 months ago
1
Aug 30 版本无法下载超过9张图的原创微博，第10张起都不下载

#405 Charrine opened 7 months ago
1
feature request: jsonc support

#404 lengyijun opened 7 months ago
1
运行时提示main文件里需要schedule_interval参数

#403 TheYJie opened 8 months ago
1
抓取某一条微博的所有评论数据

#402 zealze closed 9 months ago
1
安装依赖遇到command not found怎么解决

#401 uhaeungii opened 9 months ago
1
since_date支持时间

#400 plutonji closed 10 months ago
1
调用weibo_crawler时group ‘Nonetype’

#399 sq-shuqian opened 10 months ago
1
[bugfix]修复条件判断问题

#398 plutonji closed 10 months ago
1
在保存微博时保留换行符

#397 plutonji closed 10 months ago
1