freedomofpress / securethenews

An automated scanner and web dashboard for tracking TLS deployment across news organizations
https://securethe.news
GNU Affero General Public License v3.0
102 stars 25 forks source link

onion service scanning: check meta tags for onion-location #270

Closed redshiftzero closed 4 years ago

redshiftzero commented 4 years ago

Closes #269. Followup to #262.

This PR:

The easiest way to test once on this branch is to:

  1. Ensure you have the test data added (so you have some sites to test on). Then run a scan: make dev-scan
  2. Visit the API: http://127.0.0.1:8000/api/v1/sites/
  3. For any sites that failed during the scan, they should have a null onion_available. Otherwise, Propublica should have onion_available as true, and techcrunch should have onion_available as false.
redshiftzero commented 4 years ago

thanks for reviewing! the last commit (e8ec6bc0a696695ca5935fcc5aeff067aceb9da7) is the new change here, the prior commits are just rebasing on the latest

chigby commented 4 years ago

@redshiftzero This latest change looks great. I can merge once this is up-to-date with the base branch.