search

mitchellkrogza / apache-ultimate-bad-bot-blocker

Apache Block Bad Bots, (Referer) Spam Referrer Blocker, Vulnerability Scanners, Malware, Adware, Ransomware, Malicious Sites, Wordpress Theme Detectors and Fail2Ban Jail for Repeat Offenders
Other
826 stars 181 forks source link

Add ClaudeBot to bad_bots + reg.ru to spam_ref #202

Open ShaiMagal opened 6 months ago

ShaiMagal commented 6 months ago

Match "ClaudeBot" user-agent. Very annoying flood/crawl bot.

cat apache-access.log | grep ClaudeBot | wc -l
185447570

Match "reg.ru" referer. Spamming every day.

cat apache-access.log | grep reg.ru | wc -l
10779030
ShaiMagal commented 6 months ago

@mitchellkrogza Can we approve it please? :) This bota are crazy, still spamming :/

ShaiMagal commented 6 months ago

UPDATE:

still very hard spamming:

domain.tld 111.222.333.444 - - [23/May/2024:19:00:12 +0200] "GET /XXXy?p=110&q=Farba-Biela-Ru%C5%BEov%C3%A1%2FV%C3%BDkon-35+W+3+2242424+asdasd HTTP/2.0" 200 41382 "-" "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"

And a lot of random strings...

@mitchellkrogza

UPDATE2: more people have same problem (Google is full of this stories) https://www.phpbb.com/community/viewtopic.php?t=2652265 https://www.reddit.com/r/singularity/comments/1cdm97j/anthropics_claudebot_is_aggressively_scraping_the/