search

mitchellkrogza / apache-ultimate-bad-bot-blocker

Apache Block Bad Bots, (Referer) Spam Referrer Blocker, Vulnerability Scanners, Malware, Adware, Ransomware, Malicious Sites, Wordpress Theme Detectors and Fail2Ban Jail for Repeat Offenders
Other
826 stars 181 forks source link

UPDATE linkdexbot #181

Closed MarkCiliaVincenti closed 2 years ago

MarkCiliaVincenti commented 2 years ago

linkdexbot is listed as Linkdexbot in the robots.txt but it identifies itself as linkdexbot (small letter 'l'). They claim they respect robots.txt but it could be a case that they're doing a case sensitive check.