search

Ahwxorg / Binternet

A custom Pinterest frontend, made in PHP.
GNU General Public License v3.0
116 stars 12 forks source link

Added robots.txt #31

Closed nyuuzyou closed 8 months ago

nyuuzyou commented 8 months ago

Hi. This pull request a robots.txt file to prevent search engines and other web crawlers from indexing the current instance. In the case of alternative frontends, robots are a waste of instance server resources.

Ahwxorg commented 8 months ago

Hi, thanks for the PR! I will not accept it however, since this is not, nor has it ever been an issue for Binternet since Binternet is not really used that often nor is it something that gets destroyed with a few Google indexes. (source: amount of traffic my server hits towards pinimg.com, since that's very low...)

Feel free to use this yourself though.

codedipper commented 8 months ago

Hi, thanks for the PR! I will not accept it however, since this is not, nor has it ever been an issue for Binternet since Binternet is not really used that often nor is it something that gets destroyed with a few Google indexes. (source: amount of traffic my server hits towards pinimg.com, since that's very low...)

Feel free to use this yourself though.

Just do it because it's good practice. The nginx part doesn't really make sense though because it's a static file?