Chunk select query to avoid running out of memory with large tables

nqxcode / laravel-lucene-search

Laravel 4.2, 5.* package for full-text search over Eloquent models based on ZF2 Lucene.

73 stars 28 forks source link

Chunk select query to avoid running out of memory with large tables #22

Closed jimpeters closed 8 years ago

jimpeters commented 8 years ago

What thoughts do you have on doing something like this? Tried to index a table with 300k rows and it quickly ran over 8GB of memory trying to index 4 fields on the table.