astrolabsoftware / fink-broker

Astronomy Broker based on Apache Spark
https://fink-broker.org
Apache License 2.0
68 stars 13 forks source link

Improve ArgoCD deployment workflow #862

Closed fjammes closed 1 month ago

fjammes commented 3 months ago

Describe the issue

The current deployment workflow is handled through a shell script, which includes deploying the k8s operators (strimzi, minio-operator, spark-operator), fink-broker, and fink-alert-simulator. However, this process is not yet fully integrated with ArgoCD and lacks automated Kafka password management.

Expected behaviour

We expect the deployment workflow to be fully integrated with ArgoCD for automated and streamlined deployment. Additionally, we expect Kafka password management to be automated for improved security.

Actual behaviour

The deployment workflow is currently handled through a shell script wich launch and synchronise ArgoCD task and Kafka password management is handled with finkctl in this shell script.

To Reproduce

Review the current deployment workflow, which is handled through a shell script. Note the lack of integration with ArgoCD and automated Kafka password management.

System Information:

Operating System: [Not applicable] Fink Version: [Not applicable] Occurred on which branch and with what commit: [Not applicable] Screenshots

Not applicable

Additional context

We propose integrating the deployment workflow with ArgoCD and implementing automated Kafka password management for improved reliability and security. This will be a separate and minor task from the main workflow improvement.

fjammes commented 2 months ago

2 questions about app sync have been asked to community: https://stackoverflow.com/questions/78922618/how-to-enforce-sync-order-in-argocd-app-of-apps-patter https://stackoverflow.com/questions/78931069/unable-to-sync-the-spark-operator-chart-2-0-0-rc-0-using-argocd