InternetHealthReport / internet-yellow-pages

A knowledge graph for Internet resources
GNU General Public License v3.0
39 stars 16 forks source link

Add `reference_time_modification` to AS Rank crawler. #140

Closed m-appel closed 1 week ago

m-appel commented 3 weeks ago

CAIDA added an option to fetch the modification times of their datasets via an API, so we should populate the field for the AS Rank crawler.

https://api.asrank.caida.org/v2/restful/datasets