mitchellkrogza / nginx-ultimate-bad-bot-blocker

Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail for Repeat Offenders
Other
3.81k stars 472 forks source link

[User-Agent] Add user-agent dataforseobot to block list #504

Closed mapcarta closed 1 year ago

mapcarta commented 1 year ago

dataforseobot

Please add "dataforseobot" to the bad SEO bots list. They have been heavily accessing our site, causing load issues. You already have "dataforseo.com" on your list, but DataForSEO are not minding that one. I have contacted DataForSEO and they replied with the following:

"Thanks for your email. I can see that you have added 'User-agent: dataforseo.com' to your robots.txt. But our bot is called 'dataforseobot'. :)"

Thank you!

CyberCr33p commented 1 year ago

Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot)