changes to sitemap generation strategy (continued)

[paul90]

continues the work started in #85, here we add:

• recreate the sitemap if sitemap.json has been deleted, also delay serving to client until the file has been created.
• remove sitemap from memory if not been updated for awhile - 20 minutes to start. Restores sitemap from sitemap.json, and recreated it if it doesn't.

[WardCunningham]

This is impressive work. Here I am watching it by extracting relevant lines from the server log.

GET /system/sitemap.json 200 7326 - 1.467 ms        fetching sitemap is fast
GET /system/sitemap.json 200 7326 - 1.565 ms        consistently fast
GET /system/sitemap.json 200 7326 - 31.650 ms       will rebuild same map when sitemap.json file is deleted
PUT /page/negated-grep/action 200 2 - 11.609 ms     now page edit means new sitemap
GET /system/sitemap.json 200 7416 - 2.205 ms        fetching larger sitemap is still fast

I see similar numbers from the chrome inspector network tab.

[paul90]

Published as part of + wiki-server@0.5.1