Describe the bug
A clear and concise description of what the bug is.
在爬取300张图片的时候会报错429,表示
(请求数量过多)。下载器会重新抓取它。
Pixiv 返回了空数据。下载器已暂停抓取,并且会在等待几分钟后继续抓取。(429)
To Reproduce
How to reproduce this problem?
爬取超过一定数量的图片,就会报这个错误
Diagnostic information
Screenshot of the problem
The URL of the page when crawling
Export the settings of the downloader and add to the attachment if needed.
Export crawl results and add to attachments if needed.
Describe the bug A clear and concise description of what the bug is. 在爬取300张图片的时候会报错429,表示 (请求数量过多)。下载器会重新抓取它。 Pixiv 返回了空数据。下载器已暂停抓取,并且会在等待几分钟后继续抓取。(429) To Reproduce How to reproduce this problem? 爬取超过一定数量的图片,就会报这个错误
Diagnostic information
诊断信息
在爬取这个画师时报错,其实之前爬取很多画师的时候也报这个错误。https://www.pixiv.net/users/57536037/artworks?p=7
Screenshots If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
Additional context Add any other context about the problem here.