search

styxit / HTPC-Manager

A fully responsive interface to manage all your favorite software on your Htpc.
http://htpc.io
MIT License
529 stars 183 forks source link

Adds a option for robots.txt #308

Closed Hellowlol closed 9 years ago

Hellowlol commented 9 years ago

If enabled the the bot should ignore everything

if not it should ignore: /restart /shutdown /logout /update

Closes: https://github.com/styxit/HTPC-Manager/issues/304

@madclicker you can use this as a example, i didnt get it working with the config

madclicker commented 9 years ago

I didn't get it working in the config also. This works for me. I can't see any reason for a bot to crawl a web app.