search

mozilla / security-advisor-shield-study

Mozilla Public License 2.0
2 stars 7 forks source link

Add 'fetch-breaches' script which fetches latest localData.json #50

Closed pdehaan closed 7 years ago

pdehaan commented 7 years ago

Since I already wrote the haveibeenpwned breaches scraper, here it is. Feel free to close it if it isn't useful.

Fixes #49

pdehaan commented 7 years ago

FWIW, the current data/recommendation/localData.json file is about 135KB.

$ ls -lh data/recommendation/*.json
135K ... data/recommendation/localData.json
Osmose commented 7 years ago

As mentioned in #49, this could be repurposed to keep domains.txt up-to-date, but I don't think we need to keep localData.json up-to-date.

I'll close this, but can review another PR with for updating domains.txt if you're interested in working on it. Thanks for the PR!