some pages just have so many links to spider, it becomes too much and not helpful for the tester. Same thing for gobuster. sometimes gobuster doesn't process the page correctly and it things that every page exists and fills up the db with paths that aquatone then needs to screenshot.
would be nice to find a elegant way to address this. initial thought is user can configure a max in the config.ini. Something like 50 links per host.
sethsec
commented
5 years ago
some pages just have so many links to spider, it becomes too much and not helpful for the tester. Same thing for gobuster. sometimes gobuster doesn't process the page correctly and it things that every page exists and fills up the db with paths that aquatone then needs to screenshot.
would be nice to find a elegant way to address this. initial thought is user can configure a max in the config.ini. Something like 50 links per host.