monperrus / crawler-user-agents

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
MIT License
1.19k stars 254 forks source link

chore: Update some links & instances #367

Closed blaine-arcjet closed 2 months ago

blaine-arcjet commented 2 months ago

While digging into each bot, I discovered some inconsistencies in the metadata. This updates/adds some URLs and instances.

monperrus commented 2 months ago

thanks @blaine-arcjet