helm / charts

⚠️(OBSOLETE) Curated applications for Kubernetes
Apache License 2.0
15.49k stars 16.79k forks source link

Logstash service is not working #24505

Closed knagasri closed 2 years ago

knagasri commented 3 years ago

We had deployed Logstash in GKE, Configured inputs and outputs in the below way inputs: main: |- input { beats { port => 5044 ssl => true ssl_certificate_authorities => ["/etc/kibana/certificate/ca.crt"] ssl_certificate => "/etc/kibana/certificate/tls.crt" ssl_key => "/etc/kibana/certificate/tls.key" ssl_verify_mode => "peer" outputs: main: |- output {

stdout { codec => rubydebug }

    elasticsearch {
      hosts => ["${ELASTICSEARCH_HOST}:${ELASTICSEARCH_PORT}"]
      manage_template => false
      user => "elastic"
      password => "${SECRET_ES_PASSWORD}"
      ssl => true
      ssl_certificate_verification => true
      cacert => "/etc/elastic/certificate/ca.crt"
      index => "%{[@metadata][beat]}-%{+YYYY.MM.dd}"
    }

Mounted the referenced secrets as well. But getting the below error on logstash logs: [2021-07-15T11:48:29,150][INFO ][logstash.javapipeline ][main] Pipeline Java execution initialization time {"seconds"=>0.0} [2021-07-15T11:48:29,150][INFO ][logstash.inputs.beats ][main] Beats inputs: Starting input listener {:address=>"0.0.0.0:5044"} [2021-07-15T11:48:30,155][ERROR][logstash.agent ] Failed to execute action {:id=>:main, :action_type=>LogStash::ConvergeResult::FailedAction, :message=>"Could not execute action: PipelineAction::Create

, action_result: false", :backtrace=>nil} [2021-07-15T11:48:32,124][INFO ][logstash.outputs.elasticsearch][main] Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[https://elastic:xxxxxx@elasticsearch-config-es-http:9200/]}} [2021-07-15T11:48:32,141][WARN ][logstash.outputs.elasticsearch][main] Restored connection to ES instance {:url=>"https://elastic:xxxxxx@elasticsearch-config-es-http:9200/"} [2021-07-15T11:48:32,142][INFO ][logstash.outputs.elasticsearch][main] ES Output version determined {:es_version=>7} [2021-07-15T11:48:32,142][WARN ][logstash.outputs.elasticsearch][main] Detected a 6.x and above cluster: the type event field won't be used to determine the document _type {:es_version=>7}

Can anyone please suggest on this.

stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Any further update will cause the issue/pull request to no longer be considered stale. Thank you for your contributions.

bridgetkromhout commented 2 years ago

Hi, @knagasri - no support is available in this repo. I suggest checking https://github.com/elastic/helm-charts/tree/main/logstash and opening an issue there if relevant.