Is your feature request related to a problem? Please describe.
Currently, the documentation does not provide clear guidance on how to block AI bots at the traffic level using firewall rules from services like Vercel and Cloudflare.
Describe the solution you'd like
I would like to see an updated section in the documentation (README file) that explains how to set up firewall rules on platforms such as Vercel and Cloudflare to block AI bots. This can be a quick write-up while linking to the actual resources that go deeper into the implementation.
Describe alternatives you've considered
Alternatives such as implementing bot detection through application-level solutions (like reCAPTCHA or rate limiting) are available, but they may not be as efficient or scalable as blocking traffic at the firewall level. These alternatives are often resource-intensive and can impact user experience.
Additional context
Including specific screenshots of Vercel and Cloudflare dashboard settings or example code snippets for setting up these rules would be helpful. It would also be great to cover scenarios where AI bots are blocked based on IP addresses, user-agent strings, or behavioral patterns.
Is your feature request related to a problem? Please describe.
Currently, the documentation does not provide clear guidance on how to block AI bots at the traffic level using firewall rules from services like Vercel and Cloudflare.
Describe the solution you'd like
I would like to see an updated section in the documentation (README file) that explains how to set up firewall rules on platforms such as Vercel and Cloudflare to block AI bots. This can be a quick write-up while linking to the actual resources that go deeper into the implementation.
Describe alternatives you've considered
Alternatives such as implementing bot detection through application-level solutions (like reCAPTCHA or rate limiting) are available, but they may not be as efficient or scalable as blocking traffic at the firewall level. These alternatives are often resource-intensive and can impact user experience.
Additional context
Including specific screenshots of Vercel and Cloudflare dashboard settings or example code snippets for setting up these rules would be helpful. It would also be great to cover scenarios where AI bots are blocked based on IP addresses, user-agent strings, or behavioral patterns.