InternetHealthReport / internet-yellow-pages

A knowledge graph for the Internet
https://iyp.iijlab.net
GNU General Public License v3.0
43 stars 18 forks source link

Openintel cleanup and addition of nameservers responsible for seen domain names #60

Closed romain-fontugne closed 1 year ago

romain-fontugne commented 1 year ago

The OpenINTEL crawler is now more unified. The same code is used for the top ranking domain lists and the authoritative name servers resolution.

The tranco1m and umbrella1m crawlers now also add the authoritative name servers corresponding to each domain names.