Too many files in a document folder causes bulk request to miss files while reindexing

CognitivZen / elasticray

Liferay elasticsearch integration

http://www.elasticray.com/

GNU Affero General Public License v3.0

12 stars 17 forks source link

Too many files in a document folder causes bulk request to miss files while reindexing #13

Closed vijay-patil closed 9 years ago

vijay-patil commented 9 years ago

A number of files are missed in the reindex if there are too many files in a single folder

vijay-patil commented 9 years ago

Since we are using bulk request builder when update documents is called, a case when there are too many files in a single folder causes this to fail because of too much memory. Removed it and used single reindex call in a loop.