atenreiro / opensquat

The openSquat is an open-source tool for detecting domain look-alikes by searching for newly registered domains that might be impersonating legit domains and brands.
https://opensquat.com
GNU General Public License v3.0
685 stars 130 forks source link

Multiple fixes and performance improvements with multiprocessing + multithreading #85

Closed maaaaz closed 1 year ago

maaaaz commented 1 year ago

Fixes for :

maaaaz commented 1 year ago

This commit also contain performance improvements, by multiprocessing domain squatting check (CPU bound), and multithreading port scans (IO bound), all achieve with Python builtin concurrent.futures library.

As a matter of example, for a domain file containing 40000 entries, and a keyword file of 480 entries:

For the port scan check, it also drastically reduces operation duration.

atenreiro commented 1 year ago

Hey @maaaaz

Awesome updates :-)

Give a few days to review the pull request.

Thanks for your contributions!

Andre

atenreiro commented 1 year ago

@maaaaz I will be making a promotional post on Linkedin and Twitter for the major features released today. Let me know if you want to be tagged for your contribution and, if yes, to which social media profile. Thanks for your great contribution :-)

maaaaz commented 1 year ago

Thanks André, if you want, you can just include my Github handle.

atenreiro commented 1 year ago

Thanks André, if you want, you can just include my Github handle.

awesome! thanks