Recently I've tried to use LinkFinder on quite big number of domains (more than 30k) and it hanged at some point because there is no timeout option specified at urlopen. By default urlopen will have infinite timeout.
So I've added this option and default 10 second timeout.
Hi,
Recently I've tried to use LinkFinder on quite big number of domains (more than 30k) and it hanged at some point because there is no timeout option specified at
urlopen
. By defaulturlopen
will have infinite timeout.So I've added this option and default 10 second timeout.
P.S. Thanks for the tool 😃