search

mtlevolio / pylinkchecker

standalone and pure python link checker and crawler that traverses a web site and reports errors
Other
34 stars 8 forks source link

Hammer prevention #21

Open realyst2k opened 7 years ago

realyst2k commented 7 years ago

I can't find anything obvious in the docs for this, but any built-in functionality to control how fast it moves from URL to the next? Basically a small delay to prevent "hammering" a server?