jprante / elasticsearch-knapsack

Knapsack plugin is an import/export tool for Elasticsearch
Apache License 2.0
472 stars 77 forks source link

"client is closed" error during import #50

Open TheDeveloper opened 10 years ago

TheDeveloper commented 10 years ago

Seems to happen intermittently but when it does it cancels the whole import which then needs to be restarted:

[2014-07-11 14:28:08,202][ERROR][org.xbib.elasticsearch.action.RestExportAction] [Count Nefaria] client is closed
org.elasticsearch.ElasticsearchIllegalStateException: client is closed
        at org.xbib.elasticsearch.support.client.bulk.BulkTransportClient.index(BulkTransportClient.java:266)
        at org.xbib.elasticsearch.action.RestExportAction$ExportThread.run(RestExportAction.java:350)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)

On ES 1.2.1 running in cluster mode with 4 nodes.

jprante commented 10 years ago

The knapsack indexer process closes itself for caution if something failed. There may be underlying exceptions in the ES cluster which are unfortunately not logged. Stay tuned for the next version for better diagnostics and resiliency.