search

privacy-tech-lab / privacy-pioneer-web-crawler

Web crawler for detecting websites' data collection and sharing practices at scale using Privacy Pioneer
https://privacytechlab.org/
MIT License
0 stars 0 forks source link

Issue with reloading ML in Firefox after Recompiling Extension #20

Closed JoeChampeau closed 3 months ago

JoeChampeau commented 3 months ago

@danielgoldelman found a bug with the Google Cloud VM wherein old ML models would remain cached in Firefox when running crawls, causing location classifiers to fail when loading in a new .xpi of the extension. We should look for a way to consistently reset this to ensure the proper ML model is always being loaded.

SebastianZimmeck commented 3 months ago

And @danielgoldelman will document this somewhere (TBD) so that @dadak-dom and @natelevinson10 know what to do (and that description will also go into @danielgoldelman's thesis).

JoeChampeau commented 3 months ago

The major issue with loading in the ML should be fixed now, and crawls seem to be detecting location just fine. Will be linking a PR soon.