Finalize strategy to deal with sources with long response time

projectdiscovery / subfinder

Fast passive subdomain enumeration tool.

https://projectdiscovery.io

MIT License

10.12k stars 1.27k forks source link

Finalize strategy to deal with sources with long response time #257

Closed ehsandeep closed 4 years ago

ehsandeep commented 4 years ago

What's the problem (or question)?

Few sources take so long with the response and eventually impact the performance in general.

Do you have an idea for a solution?

Exclude them on default run, and have a flag to run -all sources OR the opposite side,
Have a flag as -fast which will run good list of sources with good response time and run all sources on default.

ehsandeep commented 4 years ago

With the latest addition of GitHub and few long-running sources, we are opting to exclude them on default run, you can still run all the sources using -all flag, I will list sources which will be excluded from the default run.

ehsandeep commented 4 years ago

Default sources to run:-

  - alienvault
  - binaryedge
  - bufferover
  - certspotter
  - certspotterold
  - censys
  - chaos 
  - crtsh
  - dnsdumpster
  - hackertarget
  - intelx
  - ipv4info
  - passivetotal
  - securitytrails
  - shodan
  - spyse
  - sublist3r
  - threatcrowd
  - threatminer
  - virustotal