dataabc / weiboSpider

新浪微博爬虫,用python爬取新浪微博数据
8.44k stars 1.98k forks source link

报错一大堆 #573

Open MrTurtlelovel opened 6 months ago

MrTurtlelovel commented 6 months ago

为了更好的解决问题,请认真回答下面的问题。等到问题解决,请及时关闭本issue。

答:github

答:是

答:是

答:

答:

答: PS D:\下载\qq\3105088783\FileRecv\2024大二下\认识实习\weiboSpider-master> & D:/Anaconda/python.exe d:/下载/qq/3105088783/FileRecv/2024大二下/认识实习/weiboSpider-master/weiboSpider-master/weibo_spider/main.py list index out of range Traceback (most recent call last): File "C:\Users\JackieTao\AppData\Roaming\Python\Python310\site-packages\weibo_spider\parser\index_parser.py", line 39, in get_user self.user.weibo_num = string_to_int(user_info[0][3:-1]) IndexError: list index out of range None


'NoneType' object has no attribute 'nickname' Traceback (most recent call last): File "C:\Users\JackieTao\AppData\Roaming\Python\Python310\site-packages\weibo_spider\spider.py", line 226, in _get_filepath
dir_name = self.user.nickname AttributeError: 'NoneType' object has no attribute 'nickname' expected str, bytes or os.PathLike object, not NoneType Traceback (most recent call last): File "C:\Users\JackieTao\AppData\Roaming\Python\Python310\site-packages\weibo_spider\writer\csv_writer.py", line 25, in init with open(self.file_path, 'a', encoding='utf-8-sig', TypeError: expected str, bytes or os.PathLike object, not NoneType 'NoneType' object has no attribute 'nickname' Traceback (most recent call last): File "C:\Users\JackieTao\AppData\Roaming\Python\Python310\site-packages\weibo_spider\spider.py", line 226, in _get_filepath
dir_name = self.user.nickname AttributeError: 'NoneType' object has no attribute 'nickname' 'NoneType' object has no attribute 'dict' Traceback (most recent call last): File "C:\Users\JackieTao\AppData\Roaming\Python\Python310\site-packages\weibo_spider\spider.py", line 313, in get_one_user
self.write_user(self.user) File "C:\Users\JackieTao\AppData\Roaming\Python\Python310\site-packages\weibo_spider\spider.py", line 137, in write_user
writer.write_user(user) File "C:\Users\JackieTao\AppData\Roaming\Python\Python310\site-packages\weibo_spider\writer\txt_writer.py", line 29, in write_user [v + ':' + str(self.user.dict[k]) for k, v in self.user_desc]) File "C:\Users\JackieTao\AppData\Roaming\Python\Python310\site-packages\weibo_spider\writer\txt_writer.py", line 29, in [v + ':' + str(self.user.dict[k]) for k, v in self.user_desc]) AttributeError: 'NoneType' object has no attribute 'dict' PS D:\下载\qq\3105088783\FileRecv\2024大二下\认识实习\weiboSpider-master>

dataabc commented 6 months ago

应该是速度太快被暂时限制了,一般来说,限制一段时间会自动解除。

hz0ne commented 4 months ago

这段我尝试拆分下逻辑,目前到达限制后不会生成限制前的时间节点,报错的提示也比较模糊

Rook213 commented 4 months ago

同样问题,楼主后面运行成功了吗