search

privacy-tech-lab / gpc-web-crawler

Web crawler for detecting websites' compliance with GPC privacy preference signals at scale
https://privacytechlab.org/
MIT License
3 stars 1 forks source link

Perform April 2024 crawl #92

Closed SebastianZimmeck closed 3 months ago

SebastianZimmeck commented 5 months ago

@Mattm27, @franciscawijaya, and @sophieeng will perform the next crawl at the beginning to mid-April 2024.

SebastianZimmeck commented 4 months ago

If we want to keep the two-month interval, we should aim to start on Thursday, April 4. It takes about 13 hours to run. @katehausladen will show @franciscawijaya, @Mattm27, and @sophieeng how the crawl works. The most important part is to show what to do in case of crashes, which is also written up in the readme. But it is also good to show.