ikirt
commented
8 years ago - replaced subprocess with subprocess32 to enable the timeout feature
- updated robots_txt() to loop through a list of ports and added a timeout of 5 seconds as this was hanging on some hosts I have.
secgroundzero