Suggestion: auto-crawler

[kek0]

I think that is good to have integrade in Lesti_Fpc an auto-crawler that continuosly is caching the website, something like if a bot load the web and is the cache was refreshed for the crawled products automatically.

Obviously this crawler need to have something for avoid the server is full all time. Something similar to this: http://ecommerce.brimllc.com/cache-warmer-for-magento.html or this: http://www.extendware.com/full-page-cache-crawler-magento-extension.html thanks!

[GordonLesti]

Yes, there was such a feature in the past, but with problems.

[gferon]

I would suggest using a program like http://linkchecker.sourceforge.net/ if you want to do that. It works with any website and will also help you flag 404 links.

[karlmiles]

You could try running this one at quiet times: https://github.com/Marko-M/Inchoo_Precache

[kek0]

Thanks gferon and karlmiles for your suggestions. I will try both methods tomorrow :)

[VladanZ]

The crawler is something that is outside of the scope of FPC. You can use other existing crawlers or cache warmers as suggested in previous posts or write simple crawler for sitemap.xml URL elements.