search

monperrus / crawler-user-agents

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
MIT License
1.13k stars 243 forks source link

Add async Python HTTP Clients #271

Closed mr-linch closed 3 years ago

mr-linch commented 3 years ago

At the moment only sync Python HTTP clients is defined as bot, in this PR, I add detection of async clients aiohttp and httpx.

monperrus commented 3 years ago

Thanks a lot for your contribution!