realTobby / ImageScraper

Dumps all images from a WebSite.
GNU General Public License v3.0
8 stars 2 forks source link

Downloading duplicates #20

Closed realTobby closed 6 years ago

realTobby commented 6 years ago

I just found out that the tool downloads every image he found! And of course. thats correct, there is no restriction for that. But it would be cool to have one. Just a checkBox that states to download duplicates or not. Because of that, the dump is really slowed down in time (not power) I tested to dump a site where multiple images are used more than ones.

realTobby commented 6 years ago

I think I will just do it real quick. Lets see if I can implement that ^^

realTobby commented 6 years ago

solved with https://github.com/xSillusx/ImageScraper/commit/726d5ad9cabd8e5b51332034038a68fc663d7a51