search

mui / material-ui

Material UI: Comprehensive React component library that implements Google's Material Design. Free forever.
https://mui.com/material-ui/
MIT License
93.96k stars 32.27k forks source link

[blog] Blog pages are not indexable #40941

Open oliviertassinari opened 9 months ago

oliviertassinari commented 9 months ago

Steps to reproduce

Try to crawl the page from https://mui.com/blog/ with ahrefs or https://www.screamingfrog.co.uk/seo-spider/. It doesn't work. It doesn't work because the blog pages are not in a sitemap nor links:

Screenshot 2022-02-05 at 15 24 56

Context

A possible solution doesn't have to be with one .html per page but could also be a sitemap.

Search keywords: blog seo

alexfauquette commented 8 months ago

Copy pasting the result of the last discussion on this topic before closing the PR

I'm wondering if have a site map would not be another solution allowing google to simply crawl pages and even saving some crawl budget since blog posts are rarely updated

@alexfauquette A sitemap could solve the SEO problem. Maybe we could do it the same way as for RSS: https://github.com/mui/material-ui/pull/35777.

Some blog benchmark: notion.so/mui-org/docs-infra-Blog-52fdceef9eb04402a4ae99c845b98486.

stripe.com/blog: has pages, didn't check sitemap. github.blog: has no pages, has sitemap:github.blog/sitemap_index.xml scale.com/blog: has pages, didn't check sitemap. apollographql.com/blog: has no pages, has no sitemap. YOLO 🙈 blog.logrocket.com has pages, has sitemap blog.logrocket.com/sitemap.xml