search

mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.38k stars 928 forks source link

Ripping an enormous coomer page, always 429 error before finishing checking everything. #5391

Closed left1000 closed 5 months ago

left1000 commented 5 months ago

Ripping an enormous coomer page, always 429 error before finishing checking everything. Usually I update via -o skip="abort:10"

But it's been a long time, I wonder, I might be missing some older pages. Is there a similar flag that makes gallery-dl like 4 times slower? so that it doesn't end up hitting 429 too many requests as easily? Alternatively is there a way to pause for X minutes on 429 too many requests rather than giving up and making me rerun the command?

mikf commented 5 months ago

Use --sleep-request to make it slower.

--sleep-request 2-4

Put an o=… query parameter at the end of your input URL to have gallery-dl start from that offset. (only works in increments of 50)

https://coomer.su/onlyfans/user/NAME?o=150

Waiting on 429 errors and retrying the request is currently not possible.

left1000 commented 5 months ago

The sleep thingie worked.