Consider splitting Yandex bots into separate entries

arcjet / well-known-bots

List of well-known bots and user-agent patterns to detect them

MIT License

28 stars 1 forks source link

Consider splitting Yandex bots into separate entries #20

Open blaine-arcjet opened 2 months ago

blaine-arcjet commented 2 months ago

Currently, the pattern to match any Yandex bot is yandex\\.com\\/bots but they add that link into all bots. We should consider how fine-grained we want to identify the Yandex bots and consider creating more precise patterns.

Found while comparing to isbot RegExps.

blaine-arcjet commented 2 months ago

There's also no "instance" for yandextracker