search

monperrus / crawler-user-agents

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
MIT License
1.13k stars 243 forks source link

Add minicrawler #287

Closed OzzyCzech closed 2 years ago

OzzyCzech commented 2 years ago

Adding minicrawler (testomatobot) to the patterns.

Testomato is website monitoring service using https://github.com/testomato/minicrawler for crawling websites and uptime monitoring.

monperrus commented 2 years ago

Thanks @OzzyCzech