Closed sburkett closed 4 years ago
Hi @sburkett that file and others in the bots.d folder are for your own customization of the blocker. So blacklist-user-agents.conf serves as both a custom white & blacklist of any user agents you DO or do NOT want to allow. Even if something is allowed in my defaults, you can override it in this file, so if you don't like Googlebot for some reason, adding in this file would block it. Similarly if something is blocked in my defaults, whitelisting it in this file will override that.
Ok, I think I understand. So the package doesn't come with any sort of pre-packaged blocked user agents, etc? So I would need to construct those myself, if I understand things correctly, right? Thanks!
Yes it does - all these lists - https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/tree/master/_generator_lists are the defaults of what is blocked, allowed or limited.
These are what can be over-ridden using the include files in bots.d allowing full customization if you disagree with anything that is restricted / allowed by default.
GitHub
Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail f...
Ah ok, I was just a bit confused as I didn't see them in the conf files directly. Makes sense now, Thanks!
These are the totals of what is blocked by default.
Hi all! Running the latest version (I guess) ... V4.2020.01.1925. I just followed the automated install instructions on the README.md here. No errors during the install process.
So, I looked at one of the config files (
nginx/bots.d/blacklist-user-agents.conf
), and I don't see any actual entries in it. Just what looks like the boilerplate comments, etc. Did I miss a step, or is this normal?Thanks!