search

Chocobozzz / PeerTube

ActivityPub-federated video streaming platform using P2P directly in your web browser
https://joinpeertube.org/
GNU Affero General Public License v3.0
12.74k stars 1.46k forks source link

SEO friendly infinite scroll #6332

Open kontrollanten opened 2 months ago

kontrollanten commented 2 months ago

Describe the problem to be solved

Ahrefs is reporting orphan pages which means they find pages in sitemap.xml whom isn't linked from somewhere.

image

Describe the solution you would like

Make all video pages crawlable. https://developers.google.com/search/blog/2014/02/infinite-scroll-search-friendly

Chocobozzz commented 2 months ago

Hi,

Ahrefs seems to be an interesting tool. Can we try to fix all these problems? URLs examples would help me

Make all video pages crawlable

If I understand correctly, we list in the sitemap video URLs that cannot be fetched from regular videos list pages because the crawler should scroll the page?

kontrollanten commented 2 months ago

If I understand correctly, we list in the sitemap video URLs that cannot be fetched from regular videos list pages because the crawler should scroll the page?

Yes, that's how I understand it. I think a solution would be to add a "Load more" link in the bottom of the feed who links to "?page=X". This would also add support to direct link to a specific page in the feed, like this https://scrollsample.appspot.com/items?page=8