WMO CDN Log Capture and Analysis for Bot Detection

mozmeao / infra

Mozilla Marketing Engineering and Operations Infrastructure

https://mozilla.github.io/meao/

Mozilla Public License 2.0

59 stars 12 forks source link

WMO CDN Log Capture and Analysis for Bot Detection #1378

Closed a-kyne closed 2 years ago

a-kyne commented 2 years ago

We need to see if bots (other than GoogleBot and Google PlayBot) are crawling unlocalized WMO URLs (e.g. .../privacy/firefox/). WRT Google Play incident

We will need several days' worth of data to perform the analysis.

bkochendorfer commented 2 years ago

Sent some logs over to @pmac . Happy to pull more or whatever you might need.

Thanks!