Open elabz opened 3 years ago
Most people do not want these, neither do I, which was the purpose of the blocker from the onset. Simply whitelist any User-Agents & Referrers in the relevant files that you want to allow through.
blacklist-user-agents.conf < (both custom Black & White List) custom-bad-referrers.conf < (both custom Black & White List) whitelist-ips.conf
Did you look through existing ISSUES ?
Yes
Describe the problem you are experiencing
Sometimes working with SEO tools you actually need to get them through so they can crawl your site when you actually need it. Is there a better way to handle that situation that adding their IPs to the super white list, which looks quite clumsy?