Create Minio storage for logs, metrics, and open telemetry

computate commented 1 day ago

Motivation

NooBaa object storage has never been stable in our cluster, and is forcing us to choose another solution for object storage within OpenShift.

Deploy Minio with enough storage for Loki Logs, ACM Observability metrics, and Open Telemetry for AI Telemetry.

Discover scaling options for object storage with Minio
Deploy Minio in the test cluster
Create a Job to create a bucket for Open Telemetry in the test cluster
Test Open Telemetry and Tempo in the test cluster and connect to the Minio bucket in the test cluster
Deploy Minio in the infra cluster
Create a Job to create a bucket for ACM Observability metrics in the infra cluster
Deploy Minio in the obs cluster
Create a Job to create a bucket for Loki Logs in the obs cluster
Create a Job to create a bucket for Open Telemetry in the obs cluster

Desired - end of 2024

schwesig commented 1 day ago

/CC @schwesig

larsks commented 1 day ago

/cc @larsks

computate commented 13 hours ago

Thanks to @larsks , we will use this as an example for dex cluster authentication access control to the minio console.