yt-dlp / yt-dlp

A feature-rich command-line audio/video downloader
https://discord.gg/H5MNcFW63r
The Unlicense
90.37k stars 7.01k forks source link

min max sleep interval does not apply to thumbnail and subtitles, resulting HTTP 429 error #11580

Open Lumerica opened 23 hours ago

Lumerica commented 23 hours ago

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

Checklist

Provide a description that is worded well enough to be understood

By using --min-sleep-interval and --max-sleep-interval I expected that it applies for even subtitles or anything it downloads. However that is not the case. If you wrote a generic command to download any available subtitle the command will just run through all requested subtitles and download any subtitles without break.

This results in HTTP 429 errors and risking IP ban.

e.g. adding this command alone that I use got me few times ip ban: --write-thumbnail --min-sleep-interval 20 --max-sleep-interval 50 --write-subs --write-auto-subs --sub-format "best" --sub-langs "ja-ko,en.*,ko-orig,ja-orig,ko-ja,en,ko,ja"

So I would like to suggest to have an option to apply the interval for downloading/writing subtitle and alternatively also a separate option to apply it when downloading thumbnail. Having this option, people can just use a single command load a list of URL from text files and download just the thumbnails while having the interval applied to avoid risking IP ban.

Provide verbose output that clearly demonstrates the problem

Complete Verbose Output

No response

bashonly commented 18 hours ago
--sleep-requests SECONDS        Number of seconds to sleep between requests
                                during data extraction
--sleep-subtitles SECONDS       Number of seconds to sleep before each
                                subtitle download