search

ethercreative / seo

SEO utilities including a unique field type, sitemap & redirect manager
MIT License
276 stars 95 forks source link

The sections are not indexed and not in the sitemap #430

Open ogamacheDev opened 2 years ago

ogamacheDev commented 2 years ago

Description

I've been working with this plugin in a few sites and we noticed that the sites are not found on Google. I did a noindex checkup and the website is somehow not indexed. I also Crawled the website with Screaming Frog and it doesn't crawl the other pages.

Steps to reproduce

  1. Install the plugin
  2. Make sections
  3. Create a SEO field and map it in the sections
  4. Make sure that the noindex is unchecked
  5. Enable all the sections in the Sitemap section of settings
  6. Set the Env to production
  7. Crawl Site in a SEO program like Screaming Frog

Additional info

moondawg69 commented 2 years ago

I concur with this as well.

Just stuck the site live in production and ran it through robots testers and it cannot be indexed:

User-agent: * Disallow: /

To be honest, I know this plugin is free and I appreciate the time that's been put into it, but it's a danger to businesses etc and should be removed until fixed.

It's passing the none, noimageindex x-robots tag in the headers.

richcoopa commented 2 years ago

I had this issue and it turned out in my .env I had ENVIRONMENT=production rather than CRAFT_ENVIRONMENT=production