search

mitchellkrogza / nginx-ultimate-bad-bot-blocker

Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail for Repeat Offenders
Other
3.81k stars 472 forks source link

[User-Agent] BrandVerity #559

Closed rogerdz closed 3 months ago

rogerdz commented 3 months ago

Paste the full User-Agent String here

BrandVerity/1.0 (http://www.brandverity.com/why-is-brandverity-visiting-me)" "172.70.174.197" "0.100

Is this for Addition / Removal?

Did the User-Agent request robots.txt first?

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)


172.70.39.162 - - [26/Mar/2024:04:35:41 +0000] "GET /outback-fpr-4048a-300vdc-pre-wired-system.html HTTP/1.1" 200 15680 "" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:41.0) Gecko/20100101 Firefox/55.0 BrandVerity/1.0 (http://www.brandverity.com/why-is-brandverity-visiting-me)" "172.70.39.162" "0.100"
172.70.134.118 - - [26/Mar/2024:04:35:43 +0000] "GET /outback-fp4-vfxr3648a-01-pre-wired-inverter-system.html HTTP/1.1" 200 15908 "" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:41.0) Gecko/20100101 Firefox/55.0 BrandVerity/1.0 (http://www.brandverity.com/why-is-brandverity-visiting-me)" "172.70.134.118" "0.200"
172.70.43.72 - - [26/Mar/2024:04:35:44 +0000] "GET /outback-se-860xlc-300afci-systemedge-package.html HTTP/1.1" 200 15607 "" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:41.0) Gecko/20100101 Firefox/55.0 BrandVerity/1.0 (http://www.brandverity.com/why-is-brandverity-visiting-me)" "172.70.43.72" "0.200"
172.71.223.119 - - [26/Mar/2024:04:35:45 +0000] "GET /outback-fpr-8048a-300a-lt-pre-wired-system.html HTTP/1.1" 200 16657 "" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:41.0) Gecko/20100101 Firefox/55.0 BrandVerity/1.0 (http://www.brandverity.com/why-is-brandverity-visiting-me)" "172.71.223.119" "0.200"
172.70.38.215 - - [26/Mar/2024:04:35:45 +0000] "GET /outback-fp1-vfxr3648a-01-120vac-pre-wired-inverter-system.html HTTP/1.1" 200 15970 "" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:41.0) Gecko/20100101 Firefox/55.0 BrandVerity/1.0 (http://www.brandverity.com/why-is-brandverity-visiting-me)" "172.70.38.215" "0.100"

Additional information

Add any other context about the problem here.

mitchellkrogza commented 3 months ago

Hi @rogerdz companies that do brand surveillance do thousands of scans on people's sites and are generally considered a nuisance and the intention on this blocker is to block nuisances.

Companies that also use this data to sell services (see their pricing pages) are again using people's bandwidth and resources to earn money selling a service. Never had any complaints of these being blocked so whitelisting them for your own purposes is as simple as adding their User Agent names to your whitelist

https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/blob/master/bots.d/blacklist-user-agents.conf

GitHub
nginx-ultimate-bad-bot-blocker/bots.d/blacklist-user-agents.conf at master · mitchellkrogza/nginx-ultimate-bad-bot-blocker
Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail f...