Create robots.txt file - Githubissues

TUM-FAF / FAFSite

Anglophone Department Website

9 stars 6 forks source link

Create robots.txt file #17

Open ana-balica opened 11 years ago

ana-balica commented 11 years ago

So far not so sure if we need one, since all admin pages already have <meta name="robots" content="NONE,NOARCHIVE" />. Strange why there isn't any noindex,nofollow.