ooni / data

OONI Data CLI and Pipeline v5
https://docs.ooni.org/data
8 stars 3 forks source link

Add support for annotating targets and hostnames #75

Open hellais opened 2 months ago

hellais commented 2 months ago

It would be nice to add annotations that we can update over time related to hostnames.

Things that I would like to be able to say are flags like if the hostname hosts a domain name parking page, if the hostname is expired or any other feature that's relevant to the analysis.

See also:

Relevant issues:

hellais commented 2 months ago

Sharing additional notes from slack:

On the topic of parked domains, there is this paper that documents a methodology for automatically detecting such domains: https://www.ndss-symposium.org/ndss2015/ndss-2015-programme/parking-sensors-analyzing-and-detecting-parked-domains/. I think for a basic first pass we don’t even have to implement their ML based approach, but just use the list of the most common nameservers used by domain parking services and filter them out based on that (there is such a list in the paper).