issues
search
elvis972602
/
Kemono-scraper
A simple downloader to download media from kemono.party
MIT License
193
stars
12
forks
source link
added --page flag to limit the number of pages fetched on kemono
#56
Open
dahunni
opened
2 months ago
dahunni
commented
2 months ago
Fix: Prevent Endless Fetching and Add Page Limit Flag
Problem
The existing code had two issues:
The program would endlessly fetch the creator list due to an unintended loop.
The requests were made too quickly, causing timeouts and overloading the server.
Solution
Page Limit Flag
: Added a
--pages
flag to limit the number of pages fetched, preventing infinite loops.
Delay Between Requests
: Introduced a short delay between requests to avoid timeouts and comply with server rate limits.
Fix: Prevent Endless Fetching and Add Page Limit Flag
Problem
The existing code had two issues:
Solution
--pages
flag to limit the number of pages fetched, preventing infinite loops.