search

mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.21k stars 918 forks source link

Can gallery-dl calculate the rough size of what it's about to download before starting? #3442

Open Roccobot opened 1 year ago

Roccobot commented 1 year ago

Sometimes you already know the approximate size of the stuff you're going to download, but sometimes it is a bit of leap into the void.

I have a practical use case here: once I launched a download job from kemono.party and it went very smoothly... but it went on until it reached 100 GB, so at a certain point (hours had passed) I manually interrupted the task. It was too much to keep in any case, but even with smaller tasks, for example 10 GB, I'd decide whether to interrupt the job or not, knowing if I am at 99% of the total or the 10%.

If gallery-dl could calculate an approximate size of the stuff it is requested to download, it could also have a (customizable?) threshold set for a warning like: You're about to download 100 GB: are you sure you want to continue?

It would be really helpful.

Hrxn commented 1 year ago

Would be helpful, I agree. But I'm not sure that this is really possible. Depends on a lot of external factors, like servers providing correct response headers etc.

gallery-dl could count the links it has found, but extrapolating from that alone to the final size of all downloads? Not so sure..