search

monperrus / crawler-user-agents

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
MIT License
1.17k stars 249 forks source link

Add GPTBot #319

Closed arch1v1st closed 1 year ago

arch1v1st commented 1 year ago

https://venturebeat.com/ai/openai-launches-web-crawling-gptbot-sparking-blocking-effort-by-website-owners-and-creators/

monperrus commented 1 year ago

thanks for the suggestion.

fixed by https://github.com/monperrus/crawler-user-agents/commit/485a75bea5d596dba3838c5d560c157ce26e4483