mitchellkrogza / nginx-ultimate-bad-bot-blocker

Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail for Repeat Offenders
Other
3.97k stars 477 forks source link

[INSTALLATION] How to whitelist a user agent that is being blocked #432

Open elabz opened 3 years ago

elabz commented 3 years ago

Did you look through existing ISSUES ?

Yes

Describe the problem you are experiencing

Sometimes working with SEO tools you actually need to get them through so they can crawl your site when you actually need it. Is there a better way to handle that situation that adding their IPs to the super white list, which looks quite clumsy?

mitchellkrogza commented 3 years ago

Most people do not want these, neither do I, which was the purpose of the blocker from the onset. Simply whitelist any User-Agents & Referrers in the relevant files that you want to allow through.

blacklist-user-agents.conf < (both custom Black & White List) custom-bad-referrers.conf < (both custom Black & White List) whitelist-ips.conf