search

tuub / kitodo-mediaserver

Kitodo Mediaserver
GNU General Public License v3.0
7 stars 6 forks source link

robots.txt #272

Closed pbroman closed 5 years ago

pbroman commented 5 years ago

We should have a robots.txt file in the mediaserver with User-agent: * Disallow: /

The mediaserver itself should not be indexed by bots, since your not supposed to call it directly.

pbroman commented 5 years ago

Of course, you could also place the robots.txt in the apache proxy. Perhaps that is the simpler and better solution.

pbroman commented 5 years ago

Since the robots.txt must be on root, it makes non sense to put it in the fileserver. Closing ticket.