search

mitchellkrogza / nginx-ultimate-bad-bot-blocker

Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail for Repeat Offenders
Other
3.81k stars 472 forks source link

python / python-requests #495

Closed worldsdream closed 1 year ago

worldsdream commented 1 year ago

I do see a lot of "python" and "python-requests" on the server. Can this also be added to the list?

Paste the full User-Agent String here


Paste the full User-Agent String here (paste in between the ```     ``` markers)
Example: (serpstatbot/1.0 (advanced backlink tracking bot; http://serpstatbot.com/; abuse@serpstatbot.com)

Is this for Addition / Removal?

Did the User-Agent request robots.txt first?

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)


Post log excerpt here (paste in between the ```     ``` markers)

Additional information

Add any other context about the problem here.

mitchellkrogza commented 1 year ago

I block these in my own custom blacklist a lot of users may not want this blocked by default. Will consider addition into mainstream and users can whitelist but could break a LOT of people's own web sites who use python internally. For now add to your own custom blacklist.