subfinder / research

❄️ Research project for SubFinder core API V2
MIT License
35 stars 8 forks source link

potentially remove dnsdb.org #72

Open picatz opened 5 years ago

picatz commented 5 years ago

From what I can tell, dnsdb has implemented a rate-limiter that is preventing it from being a useful asset in our discovery with or current scraping techniques.

So, we might want to use https://github.com/chromedp/chromedp or remove dnsdb totally.