search

dataabc / weibo-crawler

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频
3.25k stars 739 forks source link

只能爬取200页微博是怎么回事？ #357

Open twilight1024 opened 1 year ago

dataabc commented 1 year ago

添加cookie看看。

twilight1024 commented 1 year ago

您好，您的邮件我已经收到！若有其他问题我将通过邮件或电话等方式联系您！

twilight1024 commented 1 year ago

添加了之后还是不行

twilight1024 commented 1 year ago

添加cookie看看。

可以了可以了

twilight1024 commented 1 year ago

添加cookie看看。

stat: path should be string, bytes, os.PathLike or integer, not NoneType Traceback (most recent call last): File "D:\weibo-crawler-master4\weibo-crawler-master\weibo.py", line 1883, in get_pages self.write_data(wrote_count) File "D:\weibo-crawler-master4\weibo-crawler-master\weibo.py", line 1836, in write_data self.write_csv(wrote_count) File "D:\weibo-crawler-master4\weibo-crawler-master\weibo.py", line 1293, in write_csv self.csv_helper(result_headers, result_data, file_path) File "D:\weibo-crawler-master4\weibo-crawler-master\weibo.py", line 1297, in csv_helper if not os.path.isfile(file_path): File "D:\anaconda\lib\genericpath.py", line 30, in isfile st = os.stat(path) TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType 信息抓取完毕

这是怎么回事呀？

UniversalRedBlue commented 8 months ago

同问，添加了cookie之后还是不行

twilight1024 commented 8 months ago

您好，您的邮件我已经收到！若有其他问题我将通过邮件或电话等方式联系您！

dataabc commented 8 months ago

是不是运行时删除了某些文件夹？

UniversalRedBlue commented 7 months ago

是不是运行时删除了某些文件夹？

使用weiboSpider就没问题了，感谢

UniversalRedBlue commented 7 months ago

使用weiboSpider解决问题了，感谢您

------------------ 原始邮件 ------------------ 发件人: "Chen @.>; 发送时间: 2023年11月30日(星期四) 凌晨1:39 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [dataabc/weibo-crawler] 只能爬取200页微博是怎么回事？ (Issue #357)

是不是运行时删除了某些文件夹？

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>