Add facebookcatalog, meta-externalagent, and meta-externalfetcher

monperrus / crawler-user-agents

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:

MIT License

1.19k stars 254 forks source link

Closed srstsavage closed 1 month ago

srstsavage commented 1 month ago

Happy to split these into three separate commits if preferred.

monperrus commented 1 month ago

thanks @srstsavage