-
**Describe the bug**
In the globalblacklist.conf list agent UptimeRobot/2.0 is marked as a good_bot, but the script identfy it as a bad bot.
**To Reproduce**
In the apache log all connection with…
-
Blocking aggressive Chinese crawlers/scrapers/bots :
https://udger.com/resources/ua-list/bot-detail?bot=AspiegelBot
AspiegelBot
I see many requests from AspiegelBot. If anyone has an opinion on…
-
Server version: Apache/2.4.29 (Ubuntu)
I tried following your given steps for Apache2.4 but when i try to test my site using curl, it seems bot blocker is not working.
Curl shows 301 may be becaus…
-
Hi,
I am using sucuri firewall and I was having issue with content scraper, I looked at my log and blocked some ip which were making a lot of request and it did stop the scraper for a day and next da…
-
I don't know if this would be possible, just an idea :)
Basically, how I'd imagine how it could work is that you could, for example in the video description, mark the sponsored text, then right cli…
-
A `facebookexternalhit` bot downloaded 50+ Gb off my personal site. The site is about 500M in size.
## Expected behavior
This bot is explicitly marked as "good" in `globalblacklist.conf` - it sh…
-
500 Internal Server Error: The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.
Reported on logs…
-
I noticed that the script whitelists Cloudflare, Bing, Yandex and Google but ignores Yahoo. Seems like an oversight.
-
## Paste the full User-Agent String here
```
Mozilla/5.0 (compatible; YaK/1.0; http://linkfluence.com/; bot@linkfluence.com)
```
## Is this for Addition / Removal?
- [x] Addition
- […
-
## Paste the full User-Agent String here
```
Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)
```
## Is this for Addition / Removal?
- [ ] Addition
- [x] Remova…