pires / kubernetes-elasticsearch-cluster

Elasticsearch cluster on top of Kubernetes made easy.
Apache License 2.0
1.51k stars 687 forks source link

fluentd - Elasticsearch host/port: Ingest node #208

Open mbecker opened 6 years ago

mbecker commented 6 years ago

Hi All,

thanks for your great work!

I'm just wondering which elasticsearch endpoint responsible to index a document.

In my case I want to setup fluentd which should post the document to the endpoint. In a simple setup with just 1 x elasticsearch service the host is like "http://elasticearch-logging" as defined in kubespray. The confiuration for fluentd in kubespray is as follows: ( https://github.com/kubernetes-incubator/kubespray/blob/2ef05fb3b7f6a23bb888b906bd2ddc82378dbfce/roles/kubernetes-apps/efk/fluentd/templates/fluentd-config.yml.j2#L425 )

host elasticsearch-logging
port 9200

(kubespray defines the service "elasticsearch-logging" for the elasticsearch pods).

In the setup defined in this git repo which service name should be used as the host for fluentd that Elasticsearch indexes the document? Is the Ingest Node responsible to index the document and that's why the host definition is "http://**elasticsearch-ingest**"? Do we need any special configuration for fluentd to send the document to elasticsearch with master, data and ingest nodes?

I haven't yet find anything in the elasticsearch documentation.