GewässerCampus is an educational project on limnology aiming to provide students the possibility to analyse, publish and discuss results of self-conducted measurements of water-quality in rivers and lakes.
Description
Add a robots.txt file to block bots from crawling the page. As GewässerCampus is a dynamic web app, crawling the page is not helpful. For SEO, the website (www.gewaessercampus.de) is more useful.
I noticed that a significant chunk of request on /measurements come from various bots. These add unnecessary strain.
Description Add a
robots.txtfile to block bots from crawling the page. As GewässerCampus is a dynamic web app, crawling the page is not helpful. For SEO, the website (www.gewaessercampus.de) is more useful.I noticed that a significant chunk of request on /measurements come from various bots. These add unnecessary strain.