Add support for web_connectivity 0.5

ooni / data

OONI Data CLI and Pipeline v5

https://docs.ooni.org/data

8 stars 4 forks source link

Add support for web_connectivity 0.5 #39

Open hellais opened 10 months ago

hellais commented 10 months ago

There are a few changes needed to the observation generation and analysis in order to fully support web_connectivity 0.5.

Things to consider include:

[x] Support the new transaction based network_events parsing (see: https://github.com/ooni/data/issues/34)
[ ] Consider as part of analysis and potentially observation generation the fact that DNS lookups are not always done via getaddrinfo
[ ] Other logic which is different in wc 0.5 that might impact obs and analysis generation

hellais commented 2 weeks ago

Inside of https://github.com/ooni/data/pull/81 support was added for properly parsing and marking the transaction_id inside of observation generation.