Open GabrieleOlmi opened 6 months ago
@GabrieleOlmi any updates from your monitoring on this one ?
I no longer detected requests coming from this bot. This is the information I found about Spider_Bot:
udger.comuseragent string/User-Agent Client Hints and/or IP address analyze->Spider_Bot/3.0 - Spider_Bot/3.0
GitHub
SpiderBot: Web Utilities . Contribute to acaldero/SpiderBot development by creating an account on GitHub.
Is this for Addition / Removal?
Did the User-Agent request robots.txt first?
Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)
Additional information
Add any other context about the problem here.