-
1. What set of websites do we want to crawl? How large should this set be? A selection from the Tranco list is always a good option.
2. Do we want to do region-specific crawls using a VPN?
-
**Source:**
https://gist.github.com/CodeAlDente/41974772ff4df5dd90855fb8c9c87ba4
-
URL you wish to be removed:
- www.houzz.com
Why you believe this to be a false positive:
Checked with many different protective DNS services and OSINT sources(using https://github.com/PeterDa…
-
Zone apexes are getting really crowded with stuff, and using multiple TXT records to jam information in there seems to be not a scaleable way to approach the issue. Perhaps choose some other method l…
-
Condition:
go version go1.11.6 linux/arm
cat top10milliondomains.txt | ~/go/bin/diosts -t 100 2>diosts.log >securitytxt.json
Source: https://www.domcop.com/files/top/top10milliondomains.csv.zip
…
-
**In raising this issue, I confirm the following (please check boxes, eg [X]) Failure to fill the template will close your issue:**
- [X] I have read and understood the [contributors guide](https:/…
-