Adding new bots and crawlers

lennerd / vipx-bot-detect

A bot detector written in PHP

MIT License

43 stars 18 forks source link

Closed rubenrua closed 8 years ago

rubenrua commented 8 years ago

Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)
Mozilla/5.0 (compatible; worldwebheritage.org/1.1; +crawl@worldwebheritage.org)
Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)
Mozilla/5.0 (compatible; SemrushBot/1~bl; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; Exploratodo/1.0; +http://www.exploratodo.com

lennerd commented 8 years ago

Thanks for the nice list of new bots. I will add them today in the evening.

rubenrua commented 8 years ago

Thanks for the package. If you need help let me know.