search

monperrus / crawler-user-agents

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
MIT License
1.13k stars 242 forks source link

Merge all yandex bots together #333

Closed fekir closed 9 months ago

fekir commented 10 months ago

Use a single regex for all bots (less mantainance burden, faster to use, ...)

Note that this also matches YandexUserproxy, which was not handled before:

Mozilla/5.0 (compatible; YandexUserproxy; robot; +http://yandex.com/bots

monperrus commented 9 months ago

thanks @fekir