Jaxkr / Truthbot.org

Defunct
GNU General Public License v3.0
2 stars 1 forks source link

can you add a way to add domains in bulk? #15

Open elypter opened 8 years ago

elypter commented 8 years ago

like the content of this page https://en.wikipedia.org/wiki/List_of_Google_domains

and what is your policy on subdomains? should all redundant subdomains like images.google.ru or maps.google.dk be added too? or will you add a wildcard system for those cases when a company controls a domain but not its subdomains like dyndns.org or when ads are being served through a subdomain of a website but actually belong to an ad network

Jaxkr commented 8 years ago

what is your policy on subdomains?

Any and all domains that match an organization should be added. Redundancy is encouraged!

I will add bulk domain additions ASAP, but wildcards may take a while to implement.

elypter commented 8 years ago

it would probably also help a lot to increase the database size if you could import results from this site automatically or easily http://www.robtex.com/dns/apple.com.html#records

elypter commented 8 years ago

for subdomains there are also ways of searching:

google: site:*.meteor.com/ -site:www.meteor.com use wolframalpha and click on subdomains with this tool https://pentest-tools.com/information-gathering/find-subdomains-of-domain (this one seems to output the most results)

scripts: https://github.com/guelfoweb/knock (a brute force python script) http://www.edge-security.com/soft/subdomainer.py (that also) https://github.com/TheRook/subbrute (also brute force and said to be the best) https://github.com/jhaddix/domain http://ha.ckers.org/fierce/ (maybe offline)