Enh: SEO

[ginatrapani]

Let's use this ticket to capture an SEO-related checklist of small improvements:

• [ ] Add noindex to front page and search results page and explore page
• [x] Set rel=canonical URL tags on maker, project, and user pages
• [ ] Add sitemap.xml
• [x] Add robots.txt
• [ ] Check to make sure new maker tabs are getting crawled correctly

What else?

[ginatrapani]

Also add to the noindex rules to:

• /add/*
• /twittersignin/

Also we can use a sitemap.xml to direct crawlers.

[anildash]

Sitemap template should basically be like this:

  <?xml version="1.0" encoding="UTF-8"?>
  <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">

   <url>
      <loc>http://www.makerbase.co/</loc>
      <lastmod>{$smarty.now|date_format:'%Y-%m-%d'}</lastmod>
      <changefreq>always</changefreq>
      <priority>0.9</priority>
   </url>
   <url>
      <loc>http://www.makerbase.co/explore/</loc>
      <lastmod>{$smarty.now|date_format:'%Y-%m-%d'}</lastmod>
      <changefreq>always</changefreq>
      <priority>1.0</priority>
   </url>
   <url>
      <loc>http://www.makerbase.co/about/</loc>
      <changefreq>weekly</changefreq>
      <priority>1.0</priority>
   </url>
   <url>
      <loc>http://www.makerbase.co/about/sponsor/</loc>
      <changefreq>weekly</changefreq>
      <priority>1.0</priority>
   </url>
   <url>
      <loc>http://www.makerbase.co/about/privacy/</loc>
      <lastmod>2015-07-30</lastmod>
      <changefreq>monthly</changefreq>
      <priority>0.3</priority>
   </url>
   <url>
      <loc>http://www.makerbase.co/about/terms/</loc>
      <lastmod>2015-07-30</lastmod>
      <changefreq> monthly </changefreq>
      <priority>0.3</priority>
   </url>

  {foreach $products as $product}
   <url>
      <loc>http://makerbase.co/m/{$product_maker->uid}/{$product_maker->slug|escape:'html'}</loc>
      <changefreq>daily</changefreq>
   </url>
  {/foreach}

  {foreach $makers as $maker}
   <url>
      <loc>http://makerbase.co/p/{$maker_product->uid}/{$maker_product->slug|escape:'html'}</loc>
      <changefreq>daily</changefreq>
   </url>
  {/foreach}
  </urlset>