search

emory-libraries / templating-engine

A PHP templating engine for powering a dynamic website
0 stars 0 forks source link

Optimize the index process to fix memory limits #102

Closed laurenhamel closed 5 years ago

laurenhamel commented 5 years ago

The indexing process started running into memory limits due to the rapidly growing size of the site. Upping the memory limit for the indexing process seemed to fix that issue, but then it yielded another issue, where the renderer lacks enough memory in order to read the excessively large data files that the indexer produced. I believe chunking the index data into smaller pieces should help solve this problem.

laurenhamel commented 5 years ago

@kristianserrano, this is ready for testing. I think we should merge this back into dev and qa, then redeploy to both environments.

laurenhamel commented 5 years ago

This is ready for acceptance, although there's nothing to show for it. The indication of whether or not this fix is working should be that the indexer does not receive any memory limit errors and that pages load as expected.