Sitemap new Structure

[jonsnowpt]

The goal is to modify the structure of the sitemaps to be prepared for the large volume of links we will have.

The new structure is optimized for better readability by search engines and is compressed. It takes up less space.

The structure is divided per language:

EN Example, the same structure is applied to the other available languages:

Main:

https://scores.betarena.com/sitemaps/en_sitemap_main_index.xml.gz

Tournaments:

https://scores.betarena.com/sitemaps/en_sitemap_tournaments_index.xml.gz
https://scores.betarena.com/sitemaps/en_sitemap_tournaments_football.xml.gz

Events:

https://scores.betarena.com/sitemaps/en_sitemap_events_index.xml.gz
https://scores.betarena.com/sitemaps/en_sitemap_events_football.xml.gz (Links for the sub-sitemaps, football_1, football_2, etc)
https://scores.betarena.com/sitemaps/en_sitemap_events_football_1.xml.gz (Max. 250k Lines)

Main:

<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
 <sitemap>
  <loc>https://scores.betarena.com/sitemaps/en_sitemap_events_index.xml.gz</loc>
  <lastmod>2022-09-26T01:53:56+00:00</lastmod>
 </sitemap>
 <sitemap>
  <loc>https://scores.betarena.com/sitemaps/en_sitemap_tournaments_index.xml.gz</loc>
  <lastmod>2022-09-26T02:17:20+00:00</lastmod>
 </sitemap>
</sitemapindex>

Tournaments:

<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
 <sitemap>
  <loc>https://www.sofascore.com/sitemaps/en_sitemap_tournaments_football.xml.gz</loc>
  <lastmod>2022-09-26T02:16:58+00:00</lastmod>
 </sitemap>
</sitemapindex>

Tournaments Football:

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml">
  <loc>https://scores.betarena.com/football/england/premier-league</loc>
  <xhtml:link rel="alternate" hreflang="en" href="https://scores.betarena.com/football/england/premier-league"/>
  <xhtml:link rel="alternate" hreflang="pt-BR" href="https://scores.betarena.com/br/football/england/premier-league"/>
  <xhtml:link rel="alternate" hreflang="pt" href="https://scores.betarena.com/pt/football/england/premier-league"/>
  <xhtml:link rel="alternate" hreflang="es" href="https://scores.betarena.com/es/football/england/premier-league"/>
  <xhtml:link rel="alternate" hreflang="it" href="https://scores.betarena.com/it/football/england/premier-league"/>
  <xhtml:link rel="alternate" hreflang="ro" href="https://scores.betarena.com/ro/football/england/premier-league"/>
  <xhtml:link rel="alternate" hreflang="se" href="https://scores.betarena.com/se/football/england/premier-league"/>
 </url>
 <url>
  <loc>https://scores.betarena.com/football/france/ligue-1</loc>
    <xhtml:link rel="alternate" hreflang="en" href="https://scores.betarena.com/football/france/ligue-1"/>
  <xhtml:link rel="alternate" hreflang="pt-BR" href="https://scores.betarena.com/br/football/france/ligue-1"/>
  <xhtml:link rel="alternate" hreflang="pt" href="https://scores.betarena.com/pt/football/france/ligue-1"/>
  <xhtml:link rel="alternate" hreflang="es" href="https://scores.betarena.com/es/football/france/ligue-1"/>
  <xhtml:link rel="alternate" hreflang="it" href="https://scores.betarena.com/it/football/france/ligue-1"/>
  <xhtml:link rel="alternate" hreflang="ro" href="https://scores.betarena.com/ro/football/france/ligue-1"/>
  <xhtml:link rel="alternate" hreflang="se" href="https://scores.betarena.com/se/football/france/ligue-1"/>
 </url>
</urlset>

Events:

<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
 <sitemap>
  <loc>https://scores.betarena.com/sitemaps/en_sitemap_events_football.xml.gz</loc>
  <lastmod>2022-10-20T01:00:23+00:00</lastmod>
 </sitemap>
</sitemapindex>

Events divided:

<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
 <sitemap>
  <loc>https://scores.betarena.com/sitemaps/en_sitemap_events_football_1.xml.gz</loc>
  <lastmod>2022-10-20T01:12:33+00:00</lastmod>
 </sitemap>
 <sitemap>
  <loc>https://scores.betarena.com/sitemaps/en_sitemap_events_football_2.xml.gz</loc>
  <lastmod>2022-10-20T01:12:53+00:00</lastmod>
 </sitemap>
 <sitemap>
  <loc>https://scores.betarena.com/sitemaps/en_sitemap_events_football_3.xml.gz</loc>
  <lastmod>2022-10-20T01:13:15+00:00</lastmod>
 </sitemap>
 <sitemap>
  <loc>https://scores.betarena.com/sitemaps/en_sitemap_events_football_4.xml.gz</loc>
  <lastmod>2022-10-20T01:13:36+00:00</lastmod>
 </sitemap>
 <sitemap>
  <loc>https://scores.betarena.com/sitemaps/en_sitemap_events_football_5.xml.gz</loc>
  <lastmod>2022-10-20T01:13:56+00:00</lastmod>
 </sitemap>
</sitemapindex>

Events Detailed (Limited to 250k lines):

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml">
 <url>
  <loc>https://scores.betarena.com/fluminense-u19-comercial-pi-u19/AaAbsBaAb</loc>
  <xhtml:link rel="alternate" hreflang="en" href="https://scores.betarena.com/fluminense-u19-comercial-pi-u19/AaAbsBaAb"/>
  <xhtml:link rel="alternate" hreflang="it" href="https://scores.betarena.com/it/fluminense-u19-comercial-pi-u19/AaAbsBaAb"/>
  <xhtml:link rel="alternate" hreflang="es" href="https://scores.betarena.com/es/fluminense-u19-comercial-pi-u19/AaAbsBaAb"/>
  <xhtml:link rel="alternate" hreflang="pt" href="https://scores.betarena.com/pt/fluminense-u19-comercial-pi-u19/AaAbsBaAb"/>
  <xhtml:link rel="alternate" hreflang="ro" href="https://scores.betarena.com/ro/fluminense-u19-comercial-pi-u19/AaAbsBaAb"/>
  <xhtml:link rel="alternate" hreflang="se" href="https://scores.betarena.com/se/fluminense-u19-comercial-pi-u19/AaAbsBaAb"/>
  <xhtml:link rel="alternate" hreflang="pt-BR" href="https://scores.betarena.com/br/fluminense-u19-comercial-pi-u19/AaAbsBaAb"/>
 </url>
 <url>
  <loc>https://scores.betarena.com/barretos-ec-lemense/AAAbsBAAb</loc>
  <xhtml:link rel="alternate" hreflang="en" href="https://scores.betarena.com/barretos-ec-lemense/AAAbsBAAb"/>
    <xhtml:link rel="alternate" hreflang="it" href="https://scores.betarena.com/it/barretos-ec-lemense/AAAbsBAAb"/>
  <xhtml:link rel="alternate" hreflang="es" href="https://scores.betarena.com/es/barretos-ec-lemense/AAAbsBAAb"/>
  <xhtml:link rel="alternate" hreflang="pt" href="https://scores.betarena.com/pt/barretos-ec-lemense/AAAbsBAAb"/>
  <xhtml:link rel="alternate" hreflang="ro" href="https://scores.betarena.com/ro/barretos-ec-lemense/AAAbsBAAb"/>
  <xhtml:link rel="alternate" hreflang="se" href="https://scores.betarena.com/se/barretos-ec-lemense/AAAbsBAAb"/>
  <xhtml:link rel="alternate" hreflang="pt-BR" href="https://scores.betarena.com/br/barretos-ec-lemense/AAAbsBAAb"/>
 </url>
</urlset>

[jonsnowpt]

@migbash

This sitemap is still in place:

https://betarena-scores-platform.herokuapp.com/sitemap.xml

It should be removed.

And the new does not seem to be present:

https://betarena-scores-platform.herokuapp.com//sitemaps/sitemap_main_index.xml.gz

[jonsnowpt]

@migbash

How can I access the sitemap?

[jonsnowpt]

@migbash

Issues:

• [x] Redundant sitemaps
• [x] Missing GZ compression
• [x] Unable to open fixtures sitemap

Redundant:

When we visit http://65.109.14.126:8500/static/sitemaps/sports-sitemap-index.xml it should show:

<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xhtml="http://www.w3.org/TR/xhtml11/xhtml11_schema.html" xsi:schemaLocation=" http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd http://www.w3.org/TR/xhtml11/xhtml11_schema.html http://www.w3.org/2002/08/xhtml/xhtml1-strict.xsd">
<url>
<loc>https://scores.betarena.com/football</loc>
<changefreq>daily</changefreq>
<priority>0.3</priority>
<xhtml:link rel="alternate" hreflang="br" href="https://scores.betarena.com/br/futebol"/>
<xhtml:link rel="alternate" hreflang="en" href="https://scores.betarena.com/football"/>
<xhtml:link rel="alternate" hreflang="es" href="https://scores.betarena.com/es/futbol"/>
<xhtml:link rel="alternate" hreflang="it" href="https://scores.betarena.com/it/calcio"/>
<xhtml:link rel="alternate" hreflang="pt" href="https://scores.betarena.com/pt/futebol"/>
<xhtml:link rel="alternate" hreflang="ro" href="https://scores.betarena.com/ro/fotbal"/>
<xhtml:link rel="alternate" hreflang="se" href="https://scores.betarena.com/se/fotboll"/>
</url>
</urlset>

Not this:

<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<sitemap>
<loc>http://65.109.14.126:8500/static/sitemaps/sports/sitemap-sports-0.xml</loc>
<lastmod>2022-11-24T00:10:41.303Z</lastmod>
</sitemap>
</sitemapindex>

Fixtures won't open:

Probably too many results; if the limit is 250k, we need to limit it to 125k and see if it works.