"Include Sitemap URL in robots.txt" inserts invalid directive

tripathi-error / googlesitemapgenerator

Automatically exported from code.google.com/p/googlesitemapgenerator

0 stars 0 forks source link

"Include Sitemap URL in robots.txt" inserts invalid directive #52

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago

What steps will reproduce the problem?
1. Enable "Include Sitemap URL in robots.txt" 
2. Verify robots.txt file
3. added line:
http://www.mysite.com/sitemap.xml/gz # Added by Google Sitemap Generator

What is the expected output? What do you see instead?
Sitemap: http://www.mysite.com/sitemap.xml/gz # Added by Google Sitemap
Generator

The directive in the robots.txt file requires a "Sitemap: " prefix.

Please use labels and text to provide additional information.

Original issue reported on code.google.com by joh...@google.com on 17 Jul 2009 at 2:23

GoogleCodeExporter commented 8 years ago

Originally reported in
http://www.google.com/support/forum/p/Webmasters/thread?hl=en&tid=1c9bdce4fcc2ce
97

Original comment by joh...@google.com on 17 Jul 2009 at 2:23

GoogleCodeExporter commented 8 years ago

wondering if there's been a resolution to this issue?  it is particularly 
bothersome
for us as we have utilized sitemap generator to automatically update robots.txt 
files
for a number of sites.  (like, more sites than we'd want to manually change.)  
and
now they all share this "syntax not understood" error.

thanks.

Original comment by adse...@vcgcorporate.com on 6 May 2010 at 2:32

GoogleCodeExporter commented 8 years ago

I'm seeing this issue as well. I was about to open an issue myself when I 
decided to search for it. Is there an ETA on a fix for this?

Original comment by kwga...@shaw.ca on 5 Apr 2011 at 11:07

Attachments:

SitemapSyntaxError.png

GoogleCodeExporter commented 8 years ago

I'm having the same issue. Please let me know if there's a resolution.  Does 
this effect robots crawling

Original comment by seocalif...@gmail.com on 13 Apr 2011 at 5:38

GoogleCodeExporter commented 8 years ago

[deleted comment]

GoogleCodeExporter commented 8 years ago

Last I compiled this tool, their source code had errors in it so I had to go in 
and manually make changes. Since it's not a very active project, I'm sure the 
source is still wrong. If you go to my blog, you see what needs to be appended 
at Step 4. 
http://vendivel.com/blog/2010/09/01/compile-and-install-google-sitemap-generator
-on-linux/

Original comment by vendi...@gmail.com on 15 Apr 2011 at 10:03

GoogleCodeExporter commented 8 years ago

I just recently installed Google Sitemap Generator and came across this issue 
while searching around for tips on configuring the service.

I think it's sad that a tool as unique and important as this is being 
neglected... And as a new user, it's disheartening. Come on Google!

Original comment by brent.fo...@gmail.com on 15 Feb 2012 at 8:23

GoogleCodeExporter commented 8 years ago

Facing the same issue. Still google has not fixed it.

Original comment by patil.vi...@gmail.com on 6 Jul 2012 at 12:55

GoogleCodeExporter commented 8 years ago

As a temporary fix, uncheck "Sitemap file submission" in sitemap configuration, 
then add Sitemap: sitemapurl into robots.txt manually. Sitemap URL is always 
the same, unless you change it in sitemap configuration, so don't change it and 
it will remain in robots.txt as a proper directive.

Original comment by zu...@wsg.co on 23 Apr 2014 at 5:13