devanshbatham / ParamSpider

Mining URLs from dark corners of Web Archives for bug hunting/fuzzing/further probing
MIT License
2.34k stars 403 forks source link

Fix Continuation Problem #126

Open nitish800 opened 1 month ago

nitish800 commented 1 month ago

When i use paramspider -L domains.txt. and for some reason if there was a error fetching a URL even after 3rd retry, the code exit and stop scanning for other URL.

This commit allows to skip the url which have error fetching after 3rd retry, and move on to other URL on the list, for me its work.