blacklanternsecurity / bbot

A recursive internet scanner for hackers.
https://www.blacklanternsecurity.com/bbot/
GNU General Public License v3.0
4k stars 366 forks source link

Optimize whitelists and blacklists to only consider hosts #1497

Closed TheTechromancer closed 6 days ago

TheTechromancer commented 1 week ago

In our main target (the seed of the scan), it makes sense to store all the events. Here you can have multiple events for the same host, e.g. http://evilcorp.com, bob@evilcorp.com, evilcorp.com:80, etc. However, for whitelists and blacklists, it's only necessary to store the hosts.

This change will help out a lot with bbot-io.

TheTechromancer commented 6 days ago

Added in https://github.com/blacklanternsecurity/bbot/pull/1496.