assetnote / kiterunner

Contextual Content Discovery Tool
GNU Affero General Public License v3.0
2.57k stars 285 forks source link

Throttling and delay #29

Open Regala opened 3 years ago

Regala commented 3 years ago

Hey!

I was playing around with kr and a host behind Clouflare - which easily blocks us with 429.

I noticed that even if I do: kr scan https://production.acme.com -w routes-small.kite -x 1 -j 1 --fail-status-codes 400,401,404,403,501,502,426,411 --delay 10s -H 'Authorization: Bearer token' kr still manages to do up to 10 it/s - it gives me the impression that it's doing some kind of optimization to slowly increase requests - which in this case it's not very helpful 😬 Also notice the --delay 10s which unless I'm using it wrong it doesn't seem to be followed.

Any ideas? Thanks!

amainz commented 2 years ago

Hi all,

I have the same experience. I tried --delay 1s for example, but I do not see that this is limited at all. I see always 59 req/s on --delay 1s or --delay 10s.

Any fixes?

h121h commented 2 years ago

I can confirm, I'm seeing the same behavior as well. I've also attempted hardcoding the delay with no success.

bug1ess commented 2 years ago

I have same issue here

mikedesu commented 2 years ago

100% same issue here! Glad I am not the only one experiencing this problem! None of the --delay settings I try appear to be registered! I really wanna use kiterunner but I cannot seem to slow it down!

meme-lord commented 2 years ago

Same here, doing a CTF where theres throttling and kiterunner just finishes instantly even with delay enabled

pescew commented 2 years ago

Same issue. Was able to throttle it in a roundabout way by running it in a VM and limiting the VNIC bandwidth, but that is not ideal.

0xbinhelal commented 1 year ago

Have we got any solutions for it now? I am facing the same issue. Cuckflare tempbans me.

mikedesu commented 1 year ago

Amazing that this issue is still opened this far into the future!