search

modxbot / migrate

A testground for migrating issues and other such fun
0 stars 0 forks source link

Add robots.txt to the Revolution package #7483

Open Martijn1981 opened 12 years ago

Martijn1981 commented 12 years ago

Martijn1981 created Redmine issue ID 7483

Hey,

I see you guys have already added a favicon.ico to Revolution. Nice work. The only thing missing now is a properly setup robots.txt file. The following contents would be great!

@

Default exclusions

User-agent: * Disallow: /assets/ Disallow: /connectors/ Disallow: /core/ Disallow: /manager/ Disallow: /setup/

For sitemaps.xml autodiscovery. Uncomment if you have one:

Sitemap: http://www.yoursite.com/sitemap.xml

@

MrReaL commented 12 years ago

MrReaL submitted:

Yeah! Would really like to see this!