YaoZeyuan / zhihuhelp

基于node&typescript重写知乎助手
https://www.yaozeyuan.online/zhihuhelp/
MIT License
854 stars 169 forks source link

抓取“回答”不成功 #125

Open Rich-999 opened 1 year ago

Rich-999 commented 1 year ago

显示好像是抓取成功了,但生成电子书没成功,卸载重装也不行。。

自定义任务运行日志登陆知乎使用说明 2023-02-05 15:37:27.120: 重新载入cookie配置 2023-02-05 15:37:27.221: 开始工作 2023-02-05 15:37:27.222: 重新载入cookie配置 2023-02-05 15:37:27.223: 开始执行任务 2023-02-05 15:37:27.223: [DispatchCommand] command start 2023-02-05 15:37:27.223: [DispatchCommand] 检查更新 2023-02-05 15:37:27.224: [InitEnv] command start 2023-02-05 15:37:27.224: [InitEnv] 检查更新 2023-02-05 15:37:27.772: [InitEnv] 初始化文件夹 2023-02-05 15:37:27.776: [InitEnv] 文件夹初始化完毕 2023-02-05 15:37:27.776: [InitEnv] 初始化数据库 2023-02-05 15:37:27.786: [InitEnv] 数据库初始化完毕 2023-02-05 15:37:27.787: [InitEnv] command finish 2023-02-05 15:37:27.787: [DispatchCommand] 创建任务实例 2023-02-05 15:37:27.787: [DispatchCommand] 执行抓取命令 2023-02-05 15:37:27.787: [FetchCustomer] command start 2023-02-05 15:37:27.787: [FetchCustomer] 从C:\Program Files\zhihuhelp\resources\app\customer_task_config.json中读取配置文件 2023-02-05 15:37:27.788: [FetchCustomer] content =>{ "configList": [ { "type": "answer", "id": "2167746971", "rawInputText": "https://www.zhihu.com/question/33939325/answer/2167746971", "comment": "", "skipFetch": false, "defaultTitle": "回答_2167746971", "lastId": "2167746971" } ], "imageQuilty": "raw", "bookTitle": "回答_2167746971", "maxQuestionOrArticleInBook": 10000, "orderByList": [ { "orderBy": "createAt", "order": "desc" } ], "comment": "", "skipFetch": false } 2023-02-05 15:37:27.789: [FetchCustomer] 开始进行自定义抓取, 共有1个任务 2023-02-05 15:37:27.789: [FetchCustomer] 合并抓取任务 2023-02-05 15:37:27.789: [FetchCustomer] 抓取任务合并完毕, 最终结果为=>{"answer":["2167746971"]} 2023-02-05 15:37:27.789: [FetchCustomer] 开始派发自定义任务=> 2023-02-05 15:37:27.789: [BatchFetchAnswer] 启动第1/1个抓取任务(2167746971) 2023-02-05 15:37:27.790: [BatchFetchAnswer] 准备抓取回答2167746971 2023-02-05 15:37:27.912: [BatchFetchAnswer] 问题33939325下的回答2167746971抓取成功, 存入数据库 2023-02-05 15:37:27.922: [BatchFetchAnswer] 问题33939325下的回答2167746971成功存入数据库 2023-02-05 15:37:27.922: [BatchFetchAnswer] 第1/1个任务(2167746971)执行完毕 2023-02-05 15:37:27.922: [BatchFetchAnswer] 派发所有待抓取任务 2023-02-05 15:37:27.923: 任务队列已满, 开始执行任务, 共1个任务待执行 2023-02-05 15:37:27.923: 队列已满, 休眠1s, 保护知乎服务器 2023-02-05 15:37:28.924: 任务队列内所有任务执行完毕 2023-02-05 15:37:28.925: [BatchFetchAnswer] 所有抓取任务执行完毕 2023-02-05 15:37:28.925: [FetchCustomer] 自定义任务抓取完毕 2023-02-05 15:37:28.925: [FetchCustomer] command finish 2023-02-05 15:37:28.925: [DispatchCommand] 抓取命令执行完毕 2023-02-05 15:37:28.926: [DispatchCommand] 执行生成电子书命令 2023-02-05 15:37:28.926: [GenerateCustomer] command start 2023-02-05 15:37:28.926: [GenerateCustomer] 从C:\Program Files\zhihuhelp\resources\app\customer_task_config.json中读取配置文件 2023-02-05 15:37:28.926: [GenerateCustomer] content =>{ "configList": [ { "type": "answer", "id": "2167746971", "rawInputText": "https://www.zhihu.com/question/33939325/answer/2167746971", "comment": "", "skipFetch": false, "defaultTitle": "回答_2167746971", "lastId": "2167746971" } ], "imageQuilty": "raw", "bookTitle": "回答_2167746971", "maxQuestionOrArticleInBook": 10000, "orderByList": [ { "orderBy": "createAt", "order": "desc" } ], "comment": "", "skipFetch": false } 2023-02-05 15:37:28.927: [GenerateCustomer] 开始输出自定义电子书, 共有1个任务 2023-02-05 15:37:28.928: [GenerateCustomer] 将任务中的数据按照问题/文章/想法进行汇总 2023-02-05 15:37:28.928: [GenerateCustomer] 处理第1/1个任务, 任务类型:answer, 任务备注: 2023-02-05 15:37:28.928: [GenerateCustomer] 获取回答2167746971 2023-02-05 15:37:28.968: [GenerateCustomer] 回答2167746971不存在, 自动跳过 2023-02-05 15:37:28.968: [GenerateCustomer] 所有数据获取完毕, 最终结果为=> 2023-02-05 15:37:28.968: [GenerateCustomer] 问题 => 0个 2023-02-05 15:37:28.969: [GenerateCustomer] 文章 => 0篇 2023-02-05 15:37:28.969: [GenerateCustomer] 想法 => 0条 2023-02-05 15:37:28.969: [GenerateCustomer] 按配置排序 2023-02-05 15:37:28.970: [GenerateCustomer] command finish 2023-02-05 15:37:28.970: [DispatchCommand] 生成电子书命令执行完毕 2023-02-05 15:37:28.970: [DispatchCommand] 所有命令执行完毕 2023-02-05 15:37:28.970: [DispatchCommand] command finish 2023-02-05 15:37:28.971: 所有任务执行完毕, 打开电子书文件夹 => C:\Program Files\zhihuhelp\resources\app\知乎助手输出的电子书

king0billy commented 1 year ago

俺也一样