search

Jules-WinnfieldX / CyberDropDownloader

Bulk Gallery Downloader for Cyberdrop.me and Other Sites
GNU General Public License v3.0
1.62k stars 182 forks source link

[BUG] Too Many Requests - Coomer #828

Closed Gaetann18 closed 6 months ago

Gaetann18 commented 6 months ago

Describe the bug A clear and concise description of what the bug is. Make sure to read the FAQ here first: https://github.com/Jules-WinnfieldX/CyberDropDownloader/wiki

when launching scraping 90% of sites return error 429. Even if I change the IP to see if the site limits via IP, it remains the same. Do you have a solution?

Setup Information

Downloader.log file You need to include the downloader.log file after the issue occurs. Majority of the time it's the only way to diagnose issues. 


INFO     : 2024-02-23 20:21:48,164 : utilities.py:95 : Starting UI...
INFO     : 2024-02-23 20:21:48,512 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/belledelphine
INFO     : 2024-02-23 20:21:54,798 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/belledelphine
INFO     : 2024-02-23 20:21:54,798 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/stellacardo
INFO     : 2024-02-23 20:21:59,950 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/stellacardo
INFO     : 2024-02-23 20:21:59,950 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/dianaholiday
INFO     : 2024-02-23 20:22:02,346 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/dianaholiday
INFO     : 2024-02-23 20:22:02,346 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/laila_laurent
INFO     : 2024-02-23 20:22:03,674 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/laila_laurent
INFO     : 2024-02-23 20:22:03,674 : utilities.py:95 : Scrape Starting: https://coomer.su/fansly/user/389134548669046784?o=0
ERROR    : 2024-02-23 20:22:06,435 : utilities.py:95 : Scrape Failed: https://coomer.su/fansly/user/389134548669046784?o=0 (429 - HTTP status code 429: Too Many Requests)
INFO     : 2024-02-23 20:22:06,437 : utilities.py:95 : Scrape Finished: https://coomer.su/fansly/user/389134548669046784?o=0
INFO     : 2024-02-23 20:22:06,438 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/lana_rain
ERROR    : 2024-02-23 20:22:06,521 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/lana_rain (429 - HTTP status code 429: Too Many Requests)
ERROR    : 2024-02-23 20:22:06,656 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/lana_rain (429 - HTTP status code 429: Too Many Requests)
INFO     : 2024-02-23 20:22:06,657 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/lana_rain
INFO     : 2024-02-23 20:22:06,658 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/dorasexplorer
ERROR    : 2024-02-23 20:22:06,740 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/dorasexplorer (429 - HTTP status code 429: Too Many Requests)
ERROR    : 2024-02-23 20:22:06,839 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/dorasexplorer (429 - HTTP status code 429: Too Many Requests)
INFO     : 2024-02-23 20:22:06,840 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/dorasexplorer
INFO     : 2024-02-23 20:22:06,840 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/obokozu
ERROR    : 2024-02-23 20:22:06,976 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/obokozu (429 - HTTP status code 429: Too Many Requests)
ERROR    : 2024-02-23 20:22:07,166 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/obokozu (429 - HTTP status code 429: Too Many Requests)
INFO     : 2024-02-23 20:22:07,168 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/obokozu
INFO     : 2024-02-23 20:22:07,168 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/ehotlovea1
ERROR    : 2024-02-23 20:22:07,259 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/ehotlovea1 (429 - HTTP status code 429: Too Many Requests)
ERROR    : 2024-02-23 20:22:07,346 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/ehotlovea1 (429 - HTTP status code 429: Too Many Requests)
INFO     : 2024-02-23 20:22:07,348 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/ehotlovea1
INFO     : 2024-02-23 20:22:07,348 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/chloewildd
ERROR    : 2024-02-23 20:22:07,431 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/chloewildd (429 - HTTP status code 429: Too Many Requests)
ERROR    : 2024-02-23 20:22:07,524 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/chloewildd (429 - HTTP status code 429: Too Many Requests)
INFO     : 2024-02-23 20:22:07,526 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/chloewildd
INFO     : 2024-02-23 20:22:07,526 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/coupledreamx
ERROR    : 2024-02-23 20:22:07,605 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/coupledreamx (429 - HTTP status code 429: Too Many Requests)
ERROR    : 2024-02-23 20:22:07,695 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/coupledreamx (429 - HTTP status code 429: Too Many Requests)
INFO     : 2024-02-23 20:22:07,697 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/coupledreamx
INFO     : 2024-02-23 20:22:07,697 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/vicalouquaofficial
ERROR    : 2024-02-23 20:22:07,780 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/vicalouquaofficial (429 - HTTP status code 429: Too Many Requests)
ERROR    : 2024-02-23 20:22:07,871 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/vicalouquaofficial (429 - HTTP status code 429: Too Many Requests)
INFO     : 2024-02-23 20:22:07,873 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/vicalouquaofficial
INFO     : 2024-02-23 20:22:07,873 : utilities.py:95 : Scrape Starting: https://coomer.su/onlyfans/user/meido_moon
ERROR    : 2024-02-23 20:22:07,957 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/meido_moon (429 - HTTP status code 429: Too Many Requests)
ERROR    : 2024-02-23 20:22:08,054 : utilities.py:95 : Scrape Failed: https://coomer.su/onlyfans/user/meido_moon (429 - HTTP status code 429: Too Many Requests)
INFO     : 2024-02-23 20:22:08,056 : utilities.py:95 : Scrape Finished: https://coomer.su/onlyfans/user/meido_moon```
Jules-WinnfieldX commented 6 months ago

Coomer tends to having a rolling ratelimit. Try again after a few days.