srx-2000 / spider_collection

python爬虫,目前库存:网易云音乐歌曲爬取,B站视频爬取,知乎问答爬取,壁纸爬取,xvideos视频爬取,有声书爬取,微博爬虫,安居客信息爬取+数据可视化,哔哩哔哩视频封面提取器,ip代理池封装,知乎百万级用户爬虫+数据分析,github用户爬虫
MIT License
1.22k stars 221 forks source link

zhihu_user_info_spider报错 #42

Closed clhne closed 9 months ago

clhne commented 9 months ago

具体项目 zhihu_user_info_spider

bug描述 2023-12-12 15:29:21 - ERROR: 用户回答获取失败,请带着以下报错去github原仓库提出issue 2023-12-12 15:29:21 - ERROR: None Traceback (most recent call last): File "/spider_collection/zhihu_user_info_spider/zhihu_user_info_spider/requester/QuestionRequester.py", line 84, in __get_single_question_user_id total_num = self.get_total(question) File "/spider_collection/zhihu_user_info_spider/zhihu_user_info_spider/requester/QuestionRequester.py", line 118, in get_total headers=self._header_with_zse_96(api_url=question_url), File "/spider_collection/zhihu_user_info_spider/zhihu_user_info_spider/requester/ModeRequester.py", line 30, in _header_with_zse_96 header["x-zse-96"] = Parser.get_x_zse_96(api_url) File "/spider_collection/zhihu_user_info_spider/zhihu_user_info_spider/parser/Parser.py", line 122, in get_x_zse_96 cookie_mes = cookie[cookie.index(star):].replace(star, '') ValueError: substring not found

bug复现步骤

  1. python spider.py
  2. ...

报错信息 2023-12-12 15:29:21 - ERROR: 用户回答获取失败,请带着以下报错去github原仓库提出issue 2023-12-12 15:29:21 - ERROR: None Traceback (most recent call last): File "/spider_collection/zhihu_user_info_spider/zhihu_user_info_spider/requester/QuestionRequester.py", line 84, in __get_single_question_user_id total_num = self.get_total(question) File "/spider_collection/zhihu_user_info_spider/zhihu_user_info_spider/requester/QuestionRequester.py", line 118, in get_total headers=self._header_with_zse_96(api_url=question_url), File "/spider_collection/zhihu_user_info_spider/zhihu_user_info_spider/requester/ModeRequester.py", line 30, in _header_with_zse_96 header["x-zse-96"] = Parser.get_x_zse_96(api_url) File "/spider_collection/zhihu_user_info_spider/zhihu_user_info_spider/parser/Parser.py", line 122, in get_x_zse_96 cookie_mes = cookie[cookie.index(star):].replace(star, '') ValueError: substring not found

系统环境

其他 其余相关描述或内容

clhne commented 9 months ago

{"error":{"message":"请求参数异常,请升级客户端后重试。","code":10003}}

srx-2000 commented 9 months ago

{"error":{"message":"请求参数异常,请升级客户端后重试。","code":10003}}

这个爬虫已经过期了,如果还想爬知乎的话可以看下本项目中的zhihuEncrypt这个加密,这里面有写知乎的加密,具体要爬取什么还请自行编写