bitnami / charts

Bitnami Helm Charts
https://bitnami.com
Other
9k stars 9.22k forks source link

[bitnami/kibana] unable to install kibana plugins #1815

Closed valerius257 closed 4 years ago

valerius257 commented 4 years ago

Which chart: bitnami/kibana:5.0.2

Description

Steps to reproduce the issue:

  1. Deploy chart with defined plugin list.

values.yaml

image:
  tag: 7.3.2

plugins:
  - https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-security/opendistro_security_kibana_plugin-1.3.0.0.zip
  - https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-alerting/opendistro-alerting-1.3.0.0.zip

readinessProbe:
  initialDelaySeconds: 300

livenessProbe:
  initialDelaySeconds: 300

Describe the results you received: Kibana pod restart with an error. No plugins are installed after pod restart.

container log output



Welcome to the Bitnami kibana container
Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-kibana
Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-kibana/issues

nami    INFO  Initializing kibana
kibana  INFO  ==> Found mounted kibana.yml configuration file
kibana  INFO 
kibana  INFO  ########################################################################
kibana  INFO   Installation parameters for kibana:
kibana  INFO     ElasticSearch Client Node: http://elasticsearch-master:9200
kibana  INFO   This installation requires no credentials.
kibana  INFO  ########################################################################
kibana  INFO 
nami    INFO  kibana successfully initialized
INFO  ==> Starting kibana... 
INFO  ==> Kibana started with PID 37. Waiting for it to be started
INFO  ==> Waiting for Kibana server: 30 remaining attempts...
INFO  ==> Waiting for Kibana server: 29 remaining attempts...
INFO  ==> Loading user files from /docker-entrypoint-initdb.d
Executing /docker-entrypoint-initdb.d/plugin-install/..2020_01_09_15_56_47.708090772/install-plugins.sh
==> Plugin installation
Total plugins defined in chart installation: 2
Installing plugin 1 out of 2: https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-security/opendistro_security_kibana_plugin-1.3.0.0.zip
Attempting to transfer from https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-security/opendistro_security_kibana_plugin-1.3.0.0.zip
Transferring 36863058 bytes....................
Transfer complete
Retrieving metadata from plugin archive
Extracting plugin archive
Extraction complete
Plugin installation complete
Installing plugin 2 out of 2: https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-alerting/opendistro-alerting-1.3.0.0.zip
Attempting to transfer from https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-alerting/opendistro-alerting-1.3.0.0.zip
Transferring 5075575 bytes....................
Transfer complete
Retrieving metadata from plugin archive
Extracting plugin archive
Extraction complete
Plugin installation complete
==> End of Plugin installation
Tailing /opt/bitnami/kibana/logs/kibana.log
/usr/bin/tail: invalid PID: ''

Describe the results you expected: Working kibana pod with installed plugins.

Version of Helm and Kubernetes:

Client: &version.Version{SemVer:"v2.16.1", GitCommit:"bbdfe5e7803a12bbdf97e94cd847859890cf4050", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.16.1", GitCommit:"bbdfe5e7803a12bbdf97e94cd847859890cf4050", GitTreeState:"clean"}
Client Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.0", GitCommit:"641856db18352033a0d96dbc99153fa3b27298e5", GitTreeState:"clean", BuildDate:"2019-03-25T15:45:25Z", GoVersion:"go1.12.1", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.0", GitCommit:"641856db18352033a0d96dbc99153fa3b27298e5", GitTreeState:"clean", BuildDate:"2019-03-25T15:45:25Z", GoVersion:"go1.12.1", Compiler:"gc", Platform:"linux/amd64"}
carrodher commented 4 years ago

Hi, I am not able to reproduce the issue using the latest chart version.

I installed it by running this command:

▶ helm install kibana \
--set elasticsearch.hosts[0]=localhost \
--set elasticsearch.port=9200 \
--set sidecars[0].name=elasticsearch \
--set sidecars[0].image=bitnami/elasticsearch:latest \
--set sidecars[0].imagePullPolicy=IfNotPresent \
--set sidecars[0].ports[0].name=http \
--set sidecars[0].ports[0].containerPort=9200 \
--set plugins[0]=https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-security/opendistro_security_kibana_plugin-1.3.0.0.zip \
--set plugins[1]=https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-alerting/opendistro-alerting-1.3.0.0.zip \
bitnami/kibana

Please, note that since the 5.0.0 version version ES is not bundled as a subchart, so I needed to specify an external ES (or add it as sidecar container, that was what I did).

▶ kubectl logs -f kibana-5d567b6649-4l545 kibana

Welcome to the Bitnami kibana container
Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-kibana
Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-kibana/issues

nami    INFO  Initializing kibana
kibana  INFO  ==> Found mounted kibana.yml configuration file
kibana  INFO
kibana  INFO  ########################################################################
kibana  INFO   Installation parameters for kibana:
kibana  INFO     ElasticSearch Client Node: http://localhost:9200
kibana  INFO   This installation requires no credentials.
kibana  INFO  ########################################################################
kibana  INFO
nami    INFO  kibana successfully initialized
INFO  ==> Starting kibana...
INFO  ==> Kibana started with PID 36. Waiting for it to be started
INFO  ==> Waiting for Kibana server: 30 remaining attempts...
INFO  ==> Waiting for Kibana server: 29 remaining attempts...
INFO  ==> Waiting for Kibana server: 28 remaining attempts...
INFO  ==> Waiting for Kibana server: 27 remaining attempts...
INFO  ==> Waiting for Kibana server: 26 remaining attempts...
INFO  ==> Waiting for Kibana server: 25 remaining attempts...
INFO  ==> Waiting for Kibana server: 24 remaining attempts...
INFO  ==> Waiting for Kibana server: 23 remaining attempts...
INFO  ==> Waiting for Kibana server: 22 remaining attempts...
INFO  ==> Waiting for Kibana server: 21 remaining attempts...
INFO  ==> Loading user files from /docker-entrypoint-initdb.d
Executing /docker-entrypoint-initdb.d/plugin-install/..2020_01_10_08_48_06.029988671/install-plugins.sh
==> Plugin installation
Total plugins defined in chart installation: 2
Installing plugin 1 out of 2: https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-security/opendistro_security_kibana_plugin-1.3.0.0.zip
Attempting to transfer from https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-security/opendistro_security_kibana_plugin-1.3.0.0.zip
Transferring 36863058 bytes....................
Transfer complete
Retrieving metadata from plugin archive
Extracting plugin archive
Extraction complete
Plugin installation was unsuccessful due to error "Plugin opendistro_security [7.3.2] is incompatible with Kibana [7.5.1]"
Installing plugin 2 out of 2: https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-alerting/opendistro-alerting-1.3.0.0.zip
Attempting to transfer from https://d3g5vo6xdbdb9a.cloudfront.net/downloads/kibana-plugins/opendistro-alerting/opendistro-alerting-1.3.0.0.zip
Transferring 5075575 bytes....................
Transfer complete
Retrieving metadata from plugin archive
Extracting plugin archive
Extraction complete
Plugin installation was unsuccessful due to error "Plugin opendistro-alerting [7.3.2] is incompatible with Kibana [7.5.1]"
==> End of Plugin installation
Tailing /opt/bitnami/kibana/logs/kibana.log
{"type":"log","@timestamp":"2020-01-10T08:48:25Z","tags":["info","plugins-system"],"pid":36,"message":"Setting up [8] plugins: [timelion,uiActions,newsfeed,inspector,embeddable,expressions,eui_utils,data]"}
{"type":"log","@timestamp":"2020-01-10T08:48:25Z","tags":["info","plugins","timelion"],"pid":36,"message":"Setting up plugin"}
{"type":"log","@timestamp":"2020-01-10T08:48:25Z","tags":["info","plugins","data"],"pid":36,"message":"Setting up plugin"}
{"type":"log","@timestamp":"2020-01-10T08:48:26Z","tags":["warning","legacy-plugins"],"pid":36,"path":"/opt/bitnami/kibana/src/legacy/core_plugins/visualizations","message":"Skipping non-plugin directory at /opt/bitnami/kibana/src/legacy/core_plugins/visualizations"}
{"type":"log","@timestamp":"2020-01-10T08:48:27Z","tags":["info","plugins-system"],"pid":36,"message":"Starting [2] plugins: [timelion,data]"}
{"type":"log","@timestamp":"2020-01-10T08:48:27Z","tags":["error","elasticsearch","admin"],"pid":36,"message":"Request error, retrying\nGET http://localhost:9200/.kibana => connect ECONNREFUSED 127.0.0.1:9200"}
{"type":"log","@timestamp":"2020-01-10T08:48:27Z","tags":["warning","elasticsearch","admin"],"pid":36,"message":"Unable to revive connection: http://localhost:9200/"}
{"type":"log","@timestamp":"2020-01-10T08:48:27Z","tags":["warning","elasticsearch","admin"],"pid":36,"message":"No living connections"}
{"type":"log","@timestamp":"2020-01-10T08:48:27Z","tags":["warning","migrations"],"pid":36,"message":"Unable to connect to Elasticsearch. Error: No Living connections"}
{"type":"log","@timestamp":"2020-01-10T08:48:30Z","tags":["warning","elasticsearch","admin"],"pid":36,"message":"Unable to revive connection: http://localhost:9200/"}
{"type":"log","@timestamp":"2020-01-10T08:48:30Z","tags":["warning","elasticsearch","admin"],"pid":36,"message":"No living connections"}
{"type":"log","@timestamp":"2020-01-10T08:48:32Z","tags":["warning","elasticsearch","admin"],"pid":36,"message":"Unable to revive connection: http://localhost:9200/"}
{"type":"log","@timestamp":"2020-01-10T08:48:32Z","tags":["warning","elasticsearch","admin"],"pid":36,"message":"No living connections"}
{"type":"log","@timestamp":"2020-01-10T08:48:35Z","tags":["warning","elasticsearch","admin"],"pid":36,"message":"Unable to revive connection: http://localhost:9200/"}
{"type":"log","@timestamp":"2020-01-10T08:48:35Z","tags":["warning","elasticsearch","admin"],"pid":36,"message":"No living connections"}
{"type":"log","@timestamp":"2020-01-10T08:48:37Z","tags":["warning","elasticsearch","admin"],"pid":36,"message":"Unable to revive connection: http://localhost:9200/"}
{"type":"log","@timestamp":"2020-01-10T08:48:37Z","tags":["warning","elasticsearch","admin"],"pid":36,"message":"No living connections"}
{"type":"log","@timestamp":"2020-01-10T08:48:40Z","tags":["info","migrations"],"pid":36,"message":"Creating index .kibana_1."}
{"type":"log","@timestamp":"2020-01-10T08:48:41Z","tags":["info","migrations"],"pid":36,"message":"Pointing alias .kibana to .kibana_1."}
{"type":"log","@timestamp":"2020-01-10T08:48:42Z","tags":["info","migrations"],"pid":36,"message":"Finished in 1374ms."}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:apm_oss@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:kibana@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:elasticsearch@7.5.1","info"],"pid":36,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:console@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:data@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:expressions@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:interpreter@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:kibana_react@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:navigation@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:region_map@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:telemetry@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:timelion@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:ui_metric@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:markdown_vis@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:metric_vis@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:table_vis@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:tagcloud@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:metrics@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:vega@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["listening","info"],"pid":36,"message":"Server running at http://0.0.0.0:5601"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["info","http","server","Kibana"],"pid":36,"message":"http server running at http://0.0.0.0:5601"}
{"type":"log","@timestamp":"2020-01-10T08:48:44Z","tags":["status","plugin:elasticsearch@7.5.1","info"],"pid":36,"state":"green","message":"Status changed from yellow to green - Ready","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"}
{"type":"response","@timestamp":"2020-01-10T08:48:45Z","tags":["api"],"pid":36,"method":"get","statusCode":200,"req":{"url":"/api/status","method":"get","headers":{"host":"127.0.0.1:5601","user-agent":"curl/7.52.1","accept":"*/*"},"remoteAddress":"127.0.0.1","userAgent":"127.0.0.1"},"res":{"statusCode":200,"responseTime":8,"contentLength":9},"message":"GET /api/status 200 8ms - 9.0B"}
{"type":"response","@timestamp":"2020-01-10T08:48:55Z","tags":[],"pid":36,"method":"get","statusCode":200,"req":{"url":"/app/kibana","method":"get","headers":{"host":"10.30.2.232:5601","user-agent":"kube-probe/1.14+","accept-encoding":"gzip","connection":"close"},"remoteAddress":"10.30.2.1","userAgent":"10.30.2.1"},"res":{"statusCode":200,"responseTime":2374,"contentLength":9},"message":"GET /app/kibana 200 2374ms - 9.0B"}
{"type":"response","@timestamp":"2020-01-10T08:49:05Z","tags":[],"pid":36,"method":"get","statusCode":200,"req":{"url":"/app/kibana","method":"get","headers":{"host":"10.30.2.232:5601","user-agent":"kube-probe/1.14+","accept-encoding":"gzip","connection":"close"},"remoteAddress":"10.30.2.1","userAgent":"10.30.2.1"},"res":{"statusCode":200,"responseTime":87,"contentLength":9},"message":"GET /app/kibana 200 87ms - 9.0B"}
{"type":"response","@timestamp":"2020-01-10T08:49:15Z","tags":[],"pid":36,"method":"get","statusCode":200,"req":{"url":"/app/kibana","method":"get","headers":{"host":"10.30.2.232:5601","user-agent":"kube-probe/1.14+","accept-encoding":"gzip","connection":"close"},"remoteAddress":"10.30.2.1","userAgent":"10.30.2.1"},"res":{"statusCode":200,"responseTime":27,"contentLength":9},"message":"GET /app/kibana 200 27ms - 9.0B"}
{"type":"response","@timestamp":"2020-01-10T08:49:25Z","tags":[],"pid":36,"method":"get","statusCode":200,"req":{"url":"/app/kibana","method":"get","headers":{"host":"10.30.2.232:5601","user-agent":"kube-probe/1.14+","accept-encoding":"gzip","connection":"close"},"remoteAddress":"10.30.2.1","userAgent":"10.30.2.1"},"res":{"statusCode":200,"responseTime":37,"contentLength":9},"message":"GET /app/kibana 200 37ms - 9.0B"}
{"type":"response","@timestamp":"2020-01-10T08:49:35Z","tags":[],"pid":36,"method":"get","statusCode":200,"req":{"url":"/app/kibana","method":"get","headers":{"host":"10.30.2.232:5601","user-agent":"kube-probe/1.14+","accept-encoding":"gzip","connection":"close"},"remoteAddress":"10.30.2.1","userAgent":"10.30.2.1"},"res":{"statusCode":200,"responseTime":25,"contentLength":9},"message":"GET /app/kibana 200 25ms - 9.0B"}
{"type":"response","@timestamp":"2020-01-10T08:49:45Z","tags":[],"pid":36,"method":"get","statusCode":200,"req":{"url":"/app/kibana","method":"get","headers":{"host":"10.30.2.232:5601","user-agent":"kube-probe/1.14+","accept-encoding":"gzip","connection":"close"},"remoteAddress":"10.30.2.1","userAgent":"10.30.2.1"},"res":{"statusCode":200,"responseTime":26,"contentLength":9},"message":"GET /app/kibana 200 26ms - 9.0B"}
{"type":"response","@timestamp":"2020-01-10T08:49:55Z","tags":[],"pid":36,"method":"get","statusCode":200,"req":{"url":"/app/kibana","method":"get","headers":{"host":"10.30.2.232:5601","user-agent":"kube-probe/1.14+","accept-encoding":"gzip","connection":"close"},"remoteAddress":"10.30.2.1","userAgent":"10.30.2.1"},"res":{"statusCode":200,"responseTime":29,"contentLength":9},"message":"GET /app/kibana 200 29ms - 9.0B"}

The installation of the plugins failed because they are not compatible with the latest kibana version, but the error you are facing doesn't appear.

In the same way, I tried the same helm install command but installing a compatible plugin:

--set plugins[0]=https://github.com/fbaligand/kibana-enhanced-table/releases/download/v1.7.0/enhanced-table-1.7.0_7.5.1.zip

and everything worked fine:

▶ kubectl logs -f kibana-5df17b5421-4l918 kibana

Welcome to the Bitnami kibana container
...
==> Plugin installation
Total plugins defined in chart installation: 1
Installing plugin 1 out of 1: https://github.com/fbaligand/kibana-enhanced-table/releases/download/v1.7.0/enhanced-table-1.7.0_7.5.1.zip
Attempting to transfer from https://github.com/fbaligand/kibana-enhanced-table/releases/download/v1.7.0/enhanced-table-1.7.0_7.5.1.zip
Transferring 715896 bytes....................
Transfer complete
Retrieving metadata from plugin archive
Extracting plugin archive
Extraction complete
Plugin installation complete
==> End of Plugin installation
Tailing /opt/bitnami/kibana/logs/kibana.log
{"type":"log","@timestamp":"2020-01-10T08:44:40Z","tags":["info","plugins-system"],"pid":36,"message":"Setting up [8] plugins: [timelion,uiActions,newsfeed,inspector,embeddable,expressions,eui_utils,data]"}
...

Are you able to try using a newer chart version or image tag? We try to fix bugs as soon as they are reported so it is possible that this problem has been solved in new versions

stale[bot] commented 4 years ago

This Issue has been automatically marked as "stale" because it has not had recent activity (for 15 days). It will be closed if no further activity occurs. Thanks for the feedback.

stale[bot] commented 4 years ago

Due to the lack of activity in the last 5 days since it was marked as "stale", we proceed to close this Issue. Do not hesitate to reopen it later if necessary.