search

impronunciable / hackdash

Ideas for a hackathon
http://hackdash.org
MIT License
70 stars 61 forks source link

Prerender - PhantomJS #107

Closed pjnovas closed 9 years ago

pjnovas commented 9 years ago
pjnovas commented 9 years ago

Change Prerender service. PhantomJS running all the time eats server resources.

  1. Only retrieve cached pages at mongodb, if not cached, continue to not prerender page.
  2. As a cron-job fetch all the pages and store them as cached at mongodb.

In this way phantomjs will run once, fetch only expired pages, store them and killing it-self. Instead of being all the time up waiting to get called from a Search engine.

pjnovas commented 9 years ago
  1. https://github.com/danzajdband/hackdash/commit/5a9068472171aa94e1fcf0bbd5dc46c24c7bcd59
pjnovas commented 9 years ago

Splited into #109