Sitemap uses /view but robots.txt disallows it - Githubissues

plone / Products.CMFPlone

The core of the Plone content management system

https://plone.org

GNU General Public License v2.0

246 stars 187 forks source link

Sitemap uses /view but robots.txt disallows it #2044

Open skleinfeldt opened 7 years ago

skleinfeldt commented 7 years ago

BUG/PROBLEM REPORT (OR OTHER COMMON ISSUE)

What I did:

I configured my site (jazkarta.com) with Google Search Console and added the sitemap, /sitemap.xml.gz
I got 28 warnings "Sitemap contains urls which are blocked by robots.txt." for File and Image objects (example: https://jazkarta.com/images/brushes-horizontal.jpeg/view)
robots.txt includes this line: "Disallow: /*view$"

What I expect to happen:

Either the sitemap should not generate urls with /view, or robots.txt should not disallow them.

What actually happened:

/view urls generated in sitemap and robots.txt disallowed.

What version of Plone/ Addons I am using:

Plone 5.0.5

hvelarde commented 7 years ago

I think this is a problem with the sitemap as it should use the canonical view and not the @@view view.

related with #1994.

jensens commented 1 year ago

is this still an issue in 5.2.10/6.0.2?