search

OpenTechFund / bypass-otf_proxy

1 stars 1 forks source link

OONI reporting integration #42

Closed maxpearl closed 3 years ago

maxpearl commented 3 years ago

Look into querying the OONI api to determine reports on specific domains being blocked. Perhaps add to automation testing?

maxpearl commented 3 years ago

Instead of using the API, we'll be implementing querying the S3 buckets. The new bucket is ooni-data-eu-fra, and the structure is: 

we are publishing measurement in jsonl file (one msmt per line) to a new bucket
e.g. s3://ooni-data-eu-fra/raw/20210609/01/GB/webconnectivity/2021060901_GB_webconnectivity.n0.0.jsonl.gz
the current layout is s3://ooni-data-eu-fra/raw/<date>/<hour>/<cc>/<testname>/<filename>.jsonl.gz
maxpearl commented 3 years ago

We have added a report here: https://api.otf.is/admin/ooni_blocks for all blocks.

Commit: https://github.com/OpenTechFund/bypass-otf_proxy/commit/77b15c2fb52b854ed4d446dbea39696d455239a3