search

yaatehr / learnedbloomfilter

MIT dsail research project
8 stars 0 forks source link

Build daily polling infra for google Safebrowsing #4

Closed yaatehr closed 4 years ago

yaatehr commented 4 years ago

Need to beat api query limit of 10000/day either run this once a day while incrementing the start position with pickle saves/ the output file length, or request/buy more queries from google

yaatehr commented 4 years ago

Likely won't be necessary as malicious urls are very hard to come by (extraction rate of about .0007% means it would take days to compile 1000 malicious urls). this isn't worth the effort in my opinion