Block crawlers or rate limit traffic on courses.p2pu.org

p2pu / marvin

Marvin helps us manage our different servers

6 stars 7 forks source link

Open dirkcuys opened 3 months ago

dirkcuys commented 3 months ago

Investigate why we have such a high rate of traffic going out from courses.p2pu.org???

Seems to be a spider (Bytespider) need to either block it or rate limit the overall level of traffic

dirkcuys commented 3 months ago

Traffic in April

Traffic in May