search

privacy-tech-lab / privacy-pioneer-web-crawler

Web crawler for detecting websites' data collection and sharing practices at scale using Privacy Pioneer
https://privacytechlab.org/
MIT License
1 stars 0 forks source link

Adjust lists for ExpressVPN change #16

Closed danielgoldelman closed 8 months ago

danielgoldelman commented 9 months ago

Since we had to change to ExpressVPN due to location elements not always corresponding to the vpn's location, we have to adjust our crawl lists. Everyone contributed to this, as it was fairly tedious and time consuming.

SebastianZimmeck commented 9 months ago

Crawling South African sites is flaky. Either we can make it reliable of we need to pick a different server location (preferably, also on the African continent).

dadak-dom commented 8 months ago

Closing this issue, as we've decided to not use expressVPN.