Isona / dirble

Fast directory scanning and scraping tool
GNU General Public License v3.0
614 stars 87 forks source link

Increase wordlist splitting factor for base scan #16

Closed sciguy16 closed 5 years ago

sciguy16 commented 5 years ago

Increasing the wordlist splitting factor for the initial scan of the base URL to max(wordlist_split, max_threads - 2) will dramatically increase the speed of the initial discovery phase while leaving a couple of "spare" threads available to start working on any discovered directories. Perhaps this could be the default behaviour, reverting to a fixed splitting factor when the user explicitly provides one on the command line.

Related: I don't think the splitting factor is sanity checked against the thread limit - would it make sense to cap wordlist_split at max_threads when validating the config?