fluent / fluentd-kubernetes-daemonset

Fluentd daemonset for Kubernetes and it Docker image
Apache License 2.0
1.27k stars 982 forks source link

Readiness failed #288

Closed daixiang0 closed 5 years ago

daixiang0 commented 5 years ago

I deploy es and fluentd in k8s, the fluend can connent to es and work as expected:

2019-04-02 09:47:02 +0000 [info]: starting fluentd-1.2.2 without supervision pid=8 ruby="2.3.3"
2019-04-02 09:47:02 +0000 [info]: gem 'fluent-plugin-detect-exceptions' version '0.0.11'
2019-04-02 09:47:02 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '2.10.5'
2019-04-02 09:47:02 +0000 [info]: gem 'fluent-plugin-kubernetes_metadata_filter' version '2.1.2'
2019-04-02 09:47:02 +0000 [info]: gem 'fluent-plugin-multi-format-parser' version '1.0.0'
2019-04-02 09:47:02 +0000 [info]: gem 'fluent-plugin-prometheus' version '1.0.1'
2019-04-02 09:47:02 +0000 [info]: gem 'fluent-plugin-systemd' version '1.0.1'
2019-04-02 09:47:02 +0000 [info]: gem 'fluentd' version '1.2.2'
2019-04-02 09:47:02 +0000 [info]: adding match pattern="fluent.**" type="null"
2019-04-02 09:47:02 +0000 [info]: adding filter pattern="kubernetes.**" type="record_transformer"
2019-04-02 09:47:02 +0000 [info]: adding filter pattern="kubernetes.**" type="kubernetes_metadata"
2019-04-02 09:47:03 +0000 [info]: adding filter pattern="kubernetes.**" type="elasticsearch_genid"
2019-04-02 09:47:03 +0000 [info]: adding match pattern="kubernetes.**" type="elasticsearch"
2019-04-02 09:47:03 +0000 [info]: Connection opened to Elasticsearch cluster => {:host=>"elasticsearch-logging", :port=>9200, :scheme=>"http"}
2019-04-02 09:47:03 +0000 [info]: Template configured and already installed.

While i want to add a liveness like below:

        livenessProbe:
          failureThreshold: 5
          httpGet:
            host: elasticsearch-logging
            path: /
            port: 9200
            scheme: HTTP
          initialDelaySeconds: 10
          periodSeconds: 10
          successThreshold: 1
          timeoutSeconds: 1
        readinessProbe:
          failureThreshold: 3
          httpGet:
            host: elasticsearch-logging
            path: /
            port: 9200
            scheme: HTTP
          periodSeconds: 10
          successThreshold: 1
          timeoutSeconds: 1

Return error:

  Warning  Unhealthy              4s    kubelet, dx-test.localdomain  Readiness probe failed: Get http://elasticsearch-logging:9200/: dial tcp: lookup elasticsearch-logging on 10.10.10.10:53: server misbehaving

10.10.10.10 is my host nameserver.

I am confused that fluend can connent to es with same config but readiness check failed. They should behave in the same way, shouldn't they?

repeatedly commented 5 years ago

Why post in this repository? This seems Elasticsearch or its image issue, right?

daixiang0 commented 5 years ago

Not sure, i post here since i think someone maybe face it.