scientist-softserv / west-virginia-university

West Virginia University
0 stars 0 forks source link

Feedback or suggestion: Site is getting hammered by web crawlers #71

Open crisr15 opened 1 year ago

crisr15 commented 1 year ago

Summary

The production site is getting hammered and was taken down by 3 different bots. Steve wrote some scripts that look at the logs before log rotate and block IPs of bots that are causing too much traffic.

What are the steps we would typically take in a scenario like this? Are there any suggestions we can provide?

Acceptance Criteria