search

jprante / elasticsearch-jdbc

JDBC importer for Elasticsearch
Apache License 2.0
2.84k stars 710 forks source link

How to make Importer Highly Available on Multi Node cluster #684

Open javashankar opened 8 years ago

javashankar commented 8 years ago

Hi Jorg & Team

I'm using ES 1.7 & JDBC Importer in 2 Node cluster, and my importer is running in Node-1..

My requirement is ' If my ES on Node-1 goes down, importer should be able to pull data into Node-2 automatically' making the system Highly available for real time data.

I have tried with following options, but they are not working. "elasticsearch" : { "host" : ["10.X.X.80","10.X.X.81:9300"], "autodiscover" : "true", "cluster" : "ProdCluster", "port" : "9300" }

Kindly help me on this.

regards, Jay

jprante commented 8 years ago

There is no team, just me.

The elasticsearch configuration is for connecting to ES, which occurs at every importer run.

High-availability with failover is a feature for a future version. It will require stateful client connections to ES to solve conflicts when multiple JDBC importers are running.