linkfluence

[robwent]

Paste the full User-Agent String here

Mozilla/5.0 (compatible; YaK/1.0; http://linkfluence.com/; bot@linkfluence.com)

Is this for Addition / Removal?

• [x] Addition
• [ ] Removal
• [ ] Keep a watch on this one

Did the User-Agent request robots.txt first?

• [ ] Yes
• [x] No

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)

54.39.178.250 - - [09/Apr/2024:07:10:44 +0000] "GET /yatco_tax_country-sitemap.xml HTTP/2.0" 301 178 "-" "Mozilla/5.0 (compatible; YaK/1.0; http://linkfluence.com/; bot@linkfluence.com)"
54.39.178.250 - - [09/Apr/2024:07:10:45 +0000] "GET /yatco_tax_country-sitemap.xml HTTP/2.0" 301 178 "-" "Mozilla/5.0 (compatible; YaK/1.0; http://linkfluence.com/; bot@linkfluence.com)"
54.39.178.250 - - [09/Apr/2024:07:10:46 +0000] "GET /yatco_tax_country-sitemap.xml HTTP/2.0" 301 178 "-" "Mozilla/5.0 (compatible; YaK/1.0; http://linkfluence.com/; bot@linkfluence.com)"

Additional information

The useragent URL redirects to another domain with utm tags showing that they came from this one.

https://www.meltwater.com/en/suite/consumer-intelligence?utm_source=direct&utm_medium=linkfluence

[mitchellkrogza]

I honestly do not support nor want companies crawling my site for any information which they then use to sell a product to customers. Anyone who wants these people crawling their sites can simply whitelist them in https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/blob/master/bots.d/blacklist-user-agents.conf as far as most of our users are concerned and will agree these are seen as nuisances and the very intention of the blocker is to block them. Very likely Meltwater will make it onto the block list too.

GitHub

nginx-ultimate-bad-bot-blocker/bots.d/blacklist-user-agents.conf at master · mitchellkrogza/nginx-ultimate-bad-bot-blocker

Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail f...

[robwent]

I opened this to suggest that it's added to the global blacklist. I used blacklist-user-agents.conf to blacklist it was it's not currently included. https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/blob/master/conf.d/globalblacklist.conf#L401

I think I maybe got the block/removal part wrong in the original post.

GitHub

nginx-ultimate-bad-bot-blocker/conf.d/globalblacklist.conf at master · mitchellkrogza/nginx-ultimate-bad-bot-blocker

Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail f...

[mitchellkrogza]

I opened this to suggest that it's added to the global blacklist. I used blacklist-user-agents.conf to blacklist it was it's not currently included. https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/blob/master/conf.d/globalblacklist.conf#L401

I think I maybe got the block/removal part wrong in the original post.

GitHubnginx-ultimate-bad-bot-blocker/conf.d/globalblacklist.conf at master · mitchellkrogza/nginx-ultimate-bad-bot-blockerNginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail f...

My apologies, I thought I saw removal

GitHub

nginx-ultimate-bad-bot-blocker/conf.d/globalblacklist.conf at master · mitchellkrogza/nginx-ultimate-bad-bot-blocker

Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail f...

[robwent]

Nah, it was me. I updated the original post.

Wasn't thinking straight last night.