xuejianxianzun / PixivBatchDownloader

Chrome 扩展,批量下载 Pixiv 的插画和小说。过滤作品、下载时重命名、转换动态图片等。Powerful Pixiv batch downloader. Batch download artworks and novels, filter works, rename when downloading, convert animated images, and more.
https://pixiv.download/
GNU General Public License v3.0
3.77k stars 216 forks source link

错误代码:429(请求数量过多),Pixiv 返回了空数据。下载器已暂停抓取 #332

Closed CodeEngieer closed 1 year ago

CodeEngieer commented 1 year ago

Describe the bug A clear and concise description of what the bug is. 在爬取300张图片的时候会报错429,表示 (请求数量过多)。下载器会重新抓取它。 Pixiv 返回了空数据。下载器已暂停抓取,并且会在等待几分钟后继续抓取。(429) To Reproduce How to reproduce this problem? 爬取超过一定数量的图片,就会报这个错误

Diagnostic information

  1. Screenshot of the problem
  2. The URL of the page when crawling
  3. Export the settings of the downloader and add to the attachment if needed.
  4. Export crawl results and add to attachments if needed.

诊断信息

  1. 问题截图
  2. 抓取时的页面 URL
  3. 如果需要,导出下载器的设置,并添加到附件。
  4. 如果需要,导出抓取结果,并添加到附件。

在爬取这个画师时报错,其实之前爬取很多画师的时候也报这个错误。https://www.pixiv.net/users/57536037/artworks?p=7 image

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Additional context Add any other context about the problem here.

xuejianxianzun commented 1 year ago

老生常谈了,这是p站的限制,高频抓取就会这样,你开启下载器的慢速抓取功能。