PactInteractive / image-downloader

Download images from the web more easily. A browser extension for Google Chrome, Microsoft Edge, and Brave.
https://chrome.google.com/webstore/detail/image-downloader/cnpniohnfphhjihaiiggeabnkjhpaldj
814 stars 299 forks source link

Image Downloader might trigger server DoS attack protection. #4

Open Radiatio opened 10 years ago

Radiatio commented 10 years ago

First, my wife has been enjoying this program to extract images of homes from real estate sites for the real estate books she builds. Makes it much faster and easier to do her work so thank you!

ISSUE: DoS triggering on some sites. My guess is the massive download of images from the site triggers a DoS attack on the server protection and it blocks her for a period of time from downloading or even viewing images.

SOLUTION: Is there a way to build in a few options to download a few groups at a time with pauses in between to avoid freaking out the servers? Perhaps a slider or a box for speed of download per image and how many groups at once. EXAMPLE: So the options could be set to download say 4 images then wait a few seconds then 4 more till it reaches it's total. Would it need randomization as well? Not sure what circumvents the false positive of DoS attack triggers. (And) Or even just a Avoid DoS checkbox in options if there was some fool proof way to make it download and not trigger.

Possible features wish list: Individual check boxes for each image would be really great and more options to filter out smaller web graphics from the download thumbnails.

Thank you very much for the great program!

vdsabev commented 10 years ago

I think the best solution for quota-based protection is a number input where you set the delay between requests. The only issue I can think of is that closing the extension's popup window can stop the downloading process before it's finished.

Can you give me some examples of sites that use this kind of DoS-protection?

Radiatio commented 10 years ago

Johnlscott.com

newhorizonrealty.net

They might pull images from listing from a central source like http://www.cevado.com/ or others.

It seemed to work for her for a few weeks but recently she has been getting locked out for a period of time then it lets her download again. But the time in between just makes it untenable.

Thanks for looking into this and for making this great extension. :) ----- Original Message -----

From: "Vladimir Sabev" notifications@github.com To: "vdsabev/image-downloader" image-downloader@noreply.github.com Cc: "Radiatio" lucky_dragon@comcast.net Sent: Tuesday, October 7, 2014 4:54:08 AM Subject: Re: [image-downloader] Image Downloader might trigger server DoS attack protection. (#4)

I think the best solution for quota-based protection is a number input where you set the delay between requests. The only issue I can think of is that closing the extension's popup window can stop the downloading process before it's finished.

Can you give me some examples of sites that use this kind of DoS-protection?

— Reply to this email directly or view it on GitHub .