mitchellkrogza / nginx-ultimate-bad-bot-blocker

Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail for Repeat Offenders
Other
3.81k stars 472 forks source link

[User-Agent] Spider_Bot/3.0 #543

Open GabrieleOlmi opened 6 months ago

GabrieleOlmi commented 6 months ago
Spider_Bot/3.0

Is this for Addition / Removal?

Did the User-Agent request robots.txt first?

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)

[11/Dec/2023:22:05:01 +0000] ip:"45.79.42.132" remote_user:"-" request:"HEAD / HTTP/1.1" status:"301" body_bytes_sent:"0" http_referer:"-" http_user_agent:"Spider_Bot/3.0"
[11/Dec/2023:22:05:02 +0000] ip:"45.79.42.132" remote_user:"-" request:"HEAD / HTTP/1.1" status:"200" body_bytes_sent:"0" http_referer:"-" http_user_agent:"Spider_Bot/3.0"

Additional information

Add any other context about the problem here.

mitchellkrogza commented 3 months ago

@GabrieleOlmi any updates from your monitoring on this one ?

GabrieleOlmi commented 2 months ago

I no longer detected requests coming from this bot. This is the information I found about Spider_Bot:

udger.com
Spider_Bot/3.0 <-Online parser :: udger.com
useragent string/User-Agent Client Hints and/or IP address analyze->Spider_Bot/3.0 - Spider_Bot/3.0
GitHub
GitHub - acaldero/SpiderBot: SpiderBot: Web Utilities
SpiderBot: Web Utilities . Contribute to acaldero/SpiderBot development by creating an account on GitHub.