search

Automattic / msm-sitemap

Comprehensive sitemaps for your WordPress VIP site. Joint collaboration between Metro.co.uk, WordPress VIP, Alley Interactive, Maker Media, 10up, and others.
73 stars 37 forks source link

Rethink full sitemap generation to allow parallel processing #140

Open pkevan opened 6 years ago

pkevan commented 6 years ago

Currently, the full sitemap generator uses option values to store the sequence of initial sitemap to generate, which can cause issues on sites where parallel processing is possible.

Rethinking this method to use something which reduces a potential race condition and allows them to be generated quicker would be good - perhaps even dropping the individual cron event setup would be better here.

mjangda commented 6 years ago

Maybe we should just use a custom table to build and track the queue of dates to be processed?

pkevan commented 6 years ago

Yes, exactly or some kind of postmeta could also work.