HCL-TECH-SOFTWARE / connections-automation

Deployment and upgrade automation scripts for HCL Connections 7.0 based on Ansible
Apache License 2.0
17 stars 31 forks source link

Elasticstack 7 not working after install #200

Open stoeps13 opened 2 years ago

stoeps13 commented 2 years ago

Hi, I tried to install Elasticstack 7 today and set the variable setup_elasticstack7=true in my variables file.

The pods are not starting:

kubectl get pods -l release=elasticstack
NAME                        READY   STATUS             RESTARTS   AGE
filebeat-7-8mk9j            0/1     InvalidImageName   0          16h
kibana-7-65994b6c5d-vhb4g   0/1     InvalidImageName   0          16h
logstash-7-0                0/1     InvalidImageName   0          16h

kubectl describe pod -l app=kibana-7

Containers:
  kibana-7:
    Container ID:   
    Image:          map[repository:connections-docker.artifactory.cwp.pnp-hcl.com tag:20210418-230758]:7.6.1
    Image ID:       
    Port:           5601/TCP

There is still a helm chart for elastic stack available, but the created pods do not work, because the container images are missing. Even fixing the image name will not help. So I checked the documentation on https://help.hcltechsw.com/connections/v7/admin/install/cp_over_intro.html?hl=kibana and found:

Elastic Stack is a collection of open-source tools that collect log data and help you visualize those logs in a central location. Specific tools in Elastic Stack include Kibana, Logstash, FileBeat, and Elasticsearch Curator. Starting with version 7, self-build images for Elastic Stack are not provided, as they are no longer needed. Instead, guidance and the documentation on how to set up Elastic Stack, either using the HCL-provided Elasticsearch 7.6.1 or any available Elasticsearch, including AWS native setup.

As there is no additional information available in the documentation, it would be great if this project can deploy a working Elasticstack on top of Connections 7. The default Kibana image won't work, as it needs to have the Searchguard plugin and Elasticsearch certificates for the connection. Regards Christoph

sabrina-yee commented 2 years ago

Thanks for reporting the issue @stoeps13. I understand that a case has been opened for this. We'll follow up to address this.

stoeps13 commented 2 years ago

Yes I opened a case too, because documentation mentions that it is possible to install, but not how.

I thought the playbook does the trick, but it just runs the helm chart and the images are missing.

Thanks!

Christoph

nbajjuri-hcl commented 2 years ago

@stoeps13 We have a new release of Elasticstack7 helm chart that works as expected. The old one is buggy (do not use it). How would i deliver to you ? You said case was opened.. Do you have case # in reference ? Please share.

stoeps13 commented 2 years ago

Hi, I already got the files in the case. Will test today. Will you update the ansible roles to include the update? Regards Christoph

nbajjuri-hcl commented 2 years ago

@stoeps13 Since it is not default, it's customers option to change if they want to install.

stoeps13 commented 2 years ago

When you enable Elastickstack in your variables, the project installs the default helm chart, which ends in errors, because of the missing images.

I would expect a working deployment when I use these scripts.

nbajjuri-hcl commented 2 years ago

@stoeps13 Can you replace the default chart with the latest one in the ExtractedFolder ? I will ask my team if we can release another version of Component Pack zip with inclusion of updated ELK7 helm chart.

nbajjuri-hcl commented 2 years ago

@stoeps13 Forgot to mention in the case update, Elasticstack7 version is 7.10.1 which requires the Elasticsearch v7.10.1. The Elasticversion 7.10.1 is available on HCL's FlexNet site. The Elasticsearch release is 7.6.1 in the Component Pack zip (7.0.0.2) which was released with CNX v7.0.

stoeps13 commented 2 years ago

It works with the 7.6.1 ES installation, but I know of the update. Same here, there should be an option to deploy container updates automatically. (Like the other tools after download from flexnet).

stoeps13 commented 2 years ago

Nice to have the Kibana 7 config in nginx now, but the helm chart and image is not available on Flexnet for download. Additionally the automation script does not install them (or push the image to registry), the updated Elasticsearch images and charts image are not installed at all (and are requirement for the Kibana 7 deployment).

sabrina-yee commented 2 years ago

Yes, the delivery of Component Pack updates is not part of the scope of this repo. It expects they are delivered via the official channel and loaded to the registry prior to running the script.

stoeps13 commented 2 years ago

Even loaded to the registry would not help, as the tags are different and the helm charts in Cp7.0.0.2 just deploy the pods from May 2021. So even after uploading to the registry, a new image does not get used.

sabrina-yee commented 2 years ago

Our Support team is working on addressing this.