search

soshel / app-engine-site-creator

Automatically exported from code.google.com/p/app-engine-site-creator
0 stars 0 forks source link

create a sitemap.xml and robots.txt #23

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago 
Feature request.

Add a handler to respond to the 
http://someurl/robots.txt
http://someurl/sitemap.xml

A way to create robot.txt somehow will be a great feature.
Also a way to mark a page in sitemap.xml

I am not sure how, but an entry in app.yaml like following will be of great
help.

  - url: /robots.txt
    script: robots.py 

  - url: /sitemap.xml
    script: sitemapxml.py

Original issue reported on code.google.com by kamal.ve...@gmail.com on 29 Jan 2009 at 9:06

GoogleCodeExporter commented 8 years ago 
This is a good idea, especially since un-authenticated reading is now available.

One option would be to just use static files in app.yaml to accomplish this.  
I'm not sure what the UI would look 
like for designing a robots.txt file, other than simply providing a textarea.

Original comment by James.Bo...@gmail.com on 1 Feb 2009 at 1:46

GoogleCodeExporter commented 8 years ago 
option of using static files in the app.yaml is workable for but then the 
content
grows dynamically, it will be pain to update the files. Also I was wondering if
somehow it is possible to control the visibility of the page altogether. Like I 
have
attached a picture.

Textarea to edit robots.txt is good workable solution.

I am new to appengine, I am not sure if this will too much of an effort.

Original comment by kamal.ve...@gmail.com on 1 Feb 2009 at 3:55

Attachments:

GoogleCodeExporter commented 8 years ago

Original comment by James.Bo...@gmail.com on 28 Mar 2009 at 9:21