search

monperrus / crawler-user-agents

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
MIT License
1.13k stars 242 forks source link

Fix pattern of Nutch crawler #356

Closed haumacher closed 2 months ago

haumacher commented 2 months ago

There are instances that only identify themselves with an upper case letter at the beginning. The original instances currently known also contain the pattern with the upper case letter.

Found in the logs of PhoneBlock.

monperrus commented 2 months ago

thanks a lot @haumacher