dataabc / weiboSpider

新浪微博爬虫,用python爬取新浪微博数据
8.46k stars 1.98k forks source link

【增量爬虫】部分微博增量获取失败:【能够获取第1页,但提示共爬取0条微博】 #528

Open mtuwei opened 1 year ago

mtuwei commented 1 year ago

答:GitHub版

答:是

答:否

答:weibo_id:7453068321

答:如果将【user_id_list】中【weibo_id】最后的【since_date】清除,全量爬虫正常。个人猜测【BUG】可能是由于:

dataabc commented 1 year ago

感谢反馈。最近不方便调试,可能要过一段时间修复。猜测可能是没有正确判断置顶微博。

you1chi commented 1 year ago

您好,想请问“将【user_id_list】中【weibo_id】最后的【since_date】清除”,此处的【weibo_id】位于何处?

stale[bot] commented 8 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

mtuwei commented 4 months ago

您好,想请问“将【user_id_list】中【weibo_id】最后的【since_date】清除”,此处的【weibo_id】位于何处?

参照项目文档中的这个子文档进行相关设置即可。【wei_id】为其中第一个字段。 image