[x] Create a wildcard robots.txt file Don't need this either, the problem was that google was looking at ovidiu.ch/robots.txt and got redirect to aufond.me/skidding/robots.txt, which generates a valid timeline. /robots.txt is 404 by default in Meteor - See #69
User-agent: *
Disallow:
[x] See what's the current state of sitemap.xml Whatever, we'll see how crawling works after putting this in prod and take it from there. Generating an XML from actual db data seems like a drag for MVP-like prioritizaton
[x] See what's the deal with webmaster tools -- Installed, in skidding@gmail.com account
Since spiderable is installed, we should
Create a wildcard robots.txt fileDon't need this either, the problem was that google was looking atovidiu.ch/robots.txtand got redirect toaufond.me/skidding/robots.txt, which generates a valid timeline./robots.txtis 404 by default in Meteor - See #69See what's the current state of sitemap.xmlWhatever, we'll see how crawling works after putting this in prod and take it from there. Generating an XML from actual db data seems like a drag for MVP-like prioritizaton