dataabc weibo-crawler issues

dataabc / weibo-crawler

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频

3.47k stars 770 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

加了cookie之后获取页面变得很慢

#466 CCMonkeyss opened 2 weeks ago
2
get_long_weibo函数重试5次仍然失败的处理

#465 MiSanl opened 2 weeks ago
1
Update lxml version in requirements.txt

#464 hjyssg closed 2 weeks ago
1
lxml的依赖应该升级了

#463 hjyssg opened 2 weeks ago
3
运行显示【KeyError: 'data'】该如何解决

#462 tsumichan1 opened 3 weeks ago
1
API 抓取失败，返回结构不符合预期（账号风控）

#461 FruityMaxine closed 1 week ago
4
爬虫速度好慢

#460 xubing8 opened 3 weeks ago
2
我写了一个浏览本地微博的工具，如果可以，能否在README中放一个链接

#459 waizui opened 3 weeks ago
1
非常感谢大佬开源的代码，我二开后，现已可以实现下载所有评论，如有需要代码，我直接提个PR

#458 ooliveso opened 1 month ago
4
Could not install packages due to an OSError: Missing dependencies for SOCKS support.

#457 LiuKk699 opened 1 month ago
1
请问为什么微博账号符合要求，却仍然cookie失效呢

#456 LvYingqi opened 1 month ago
3
下载微博视频时可以选择最高画质来下载吗？

#455 minecraftyusei opened 1 month ago
2
Update Dockerfile

#454 socratesng closed 2 months ago
1
Update README.md regarding docker command

#453 socratesng closed 2 months ago
1
Docker image文件很大

#452 socratesng opened 2 months ago
3
m.weibo.cn 无法查看全部微博

#451 diqiuonline opened 3 months ago
1
修改了 get_live_photo 方法，现在可以爬取到 live photo

#450 hwangzhun closed 4 months ago
1
打扰了，运行完毕后csv文件始终显示文件未完全加载

#449 FleeNotFree opened 4 months ago
2
LivePhoto 没有爬取到，已经添加了cookie

#448 hwangzhun opened 4 months ago
9
不错。能下载全部的原创微博图片。

#447 zhanghengli1998 opened 4 months ago
0
有办法突破专属会员鉴权吗

#446 frozenbeanxxx opened 4 months ago
3
运行之后总是显示config.json格式不正确

#445 Lzcns closed 4 months ago
2
微博爬取截止时间

#444 DoloresTu opened 5 months ago
3
无法爬取地区、学校、生日相关信息

#443 YiCheng996 opened 6 months ago
3
build(deps): bump pymysql from 1.1.0 to 1.1.1

#442 dependabot[bot] closed 6 months ago
0
build(deps): bump requests from 2.31.0 to 2.32.0

#441 dependabot[bot] closed 6 months ago
0
被ban了

#440 hyliush opened 6 months ago
1
write_post 增加POST写入方式

#439 myshero closed 6 months ago
1
build(deps): bump tqdm from 4.66.1 to 4.66.3

#438 dependabot[bot] closed 6 months ago
0
Docker 定时跑时，图片和视频是否是反复下载？

#436 niubird00 closed 6 months ago
0
sqlite储存数据非常大

#435 hibread opened 6 months ago
1
csv中抓取的用户头像链接有时候会失效怎么解决？

#434 gjxloveu opened 7 months ago
1
转发和评论好像出现了奇怪的问题

#433 gjxloveu opened 7 months ago
1
请问下载的评论在哪

#432 gjxloveu opened 7 months ago
1
怎么爬取用户的ip归属地呢？

#431 crazyegg111 opened 7 months ago
7
build(deps): bump pymongo from 4.6.1 to 4.6.3

#430 dependabot[bot] closed 7 months ago
0
“检测cookie是否有效”的功能失效

#429 Pangweiyun opened 7 months ago
2
爬取的图片名字里有一个奇怪的T

#428 Pangweiyun opened 7 months ago
1
当单个微博图片超过9张时，weibo-crawler只能下载9张

#427 Pangweiyun opened 7 months ago
2
COOKIES没有失效，但是Progress: 19%就结束了，可能是什么原因？

#426 wendywjhu opened 7 months ago
3
如何爬取微博正文时展开全文爬取到完整内容

#425 jingyoung115 opened 7 months ago
1
求助-爬微博进度100%，但是数量明显跟实际数量不一致有可能是何原因？

#424 wendywjhu closed 7 months ago
3
微博内容（Weibo.text）最大长度报错问题

#423 wendywjhu closed 7 months ago
1
某行是一条独立换行内容的时候这个换行最终读取到MYSQL会被省略掉

#422 wendywjhu opened 7 months ago
0
docker镜像

#421 JadePureOne opened 8 months ago
1
你好，我想下载所有微博正文，该怎么设置呢？

#420 copymonopoly opened 8 months ago
3
为什么按照你的文档配置还是不能写入MySQL数据库，按照之前的有错误的地方，我也添加

#419 markhome1 opened 8 months ago
3
Update README.md

#418 brian95827 closed 8 months ago
1
批量下载时，中间有提示错误，但是下载还是继续，其他微博的下载也正常

#417 wangshiyijiu opened 8 months ago
3
可不可以把爬取到的评论直接以csv的格式显示，不放在sqlte数据库里面

#416 linning00 opened 9 months ago
1