InternetHealthReport / internet-yellow-pages

A knowledge graph for Internet resources
GNU General Public License v3.0
39 stars 16 forks source link

Rework CAIDA AS Rank crawler #54

Closed m-appel closed 1 year ago

m-appel commented 1 year ago

Improve performance by first fetching all data before processing in batches. Do not create Name nodes with an empty string as name.