search

monperrus / crawler-user-agents

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
MIT License
1.13k stars 243 forks source link

Add centurybot9 #266

Closed thatcher closed 2 years ago

thatcher commented 4 years ago

https://udger.com/resources/ua-list/bot-detail?bot=centurybot9

Used to be picked up as a Go-Http-Client, but now the agent we are seeing is:

Mozilla/5.0 (compatible; +centuryb.o.t9[at]gmail.com)

Probably worth calling out into its own category as "Centurybot9" or something. Thank you for this great project!

monperrus commented 4 years ago

Thanks, would you do a pull-request?