search

monperrus / crawler-user-agents

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
MIT License
1.13k stars 243 forks source link

Add missing users agents of Yandex bots #269

Closed AlexanderVagner closed 3 years ago

AlexanderVagner commented 3 years ago

Actualize all info for Yandex bots by current (2020/11/30) information from https://yandex.com/support/webmaster/robot-workings/check-yandex-robots.xml#robot-in-logs

monperrus commented 3 years ago

Thanks a lot! How to fix the CI failure?

AlexanderVagner commented 3 years ago

@monperrus finally fixed ci, the tests are really good here 🙂

monperrus commented 3 years ago

Thanks a lot for your contribution!