Google Sitemap Generator generated robots.txt files append the following
line to an existing robot.txt file:
http://[sitemapname].xml.gz # Added by Google Sitemap Generator
Unfortunately, this line results in a Google Webmaster Tools robots.txt
parse results error of "Syntax not understood".
A quick search of the web suggests that a "Sitemap:" prefix is required for
this line.
I know the sitemap generator is BETA, but it would seem off that it would
generate robots.txt files that aren't valid, no? Is the problem perhaps
that it is appending to an existing robots.txt file? If the robots.txt
files were initially empty would sitemap generator generated files be valid?
Original issue reported on code.google.com by adse...@vcgcorporate.com on 6 May 2010 at 2:13
Original issue reported on code.google.com by
adse...@vcgcorporate.comon 6 May 2010 at 2:13