search

wandb / terraform-google-wandb

A Terraform module for deploying Weights & Biases on GCP.
Apache License 2.0
12 stars 6 forks source link

Configure Otel Agent to monitor external MySQL and Redis metrics via Terraform in Google #127

Closed amanpruthi closed 4 months ago

amanpruthi commented 4 months ago

To enhance our monitoring capabilities by configuring the OpenTelemetry (Otel) agent running on our clusters to collect key performance metrics (CPU, memory usage) from external MySQL, Redis and any other key infrastructure aspects. The setup should be executed using Terraform to ensure all permissions and configurations are correctly provisioned. The end goal is to integrate this data into Datadog for centralized monitoring in dedicated cloud.

Requirements

The Otel agent must be able to access metrics from external MySQL and Redis databases. Use Terraform to provision necessary Kubernetes resources and permissions. Confirm the ability of Otel to collect and relay accurate metrics. Make sure the otel metrics are tag correctly with attriubes from the k8s cluster Acceptance Criteria

The Otel agent must successfully collect and display MySQL and Redis CPU and memory usage metrics from external sources. All configurations must be managed via Terraform with proper versioning and module usage.

amanpruthi commented 4 months ago

There is 2 Prs linked with this issue :

https://github.com/wandb/helm-charts/pull/141 >> stackdriver subchart support https://github.com/wandb/terraform-google-wandb/pull/126 >> otel with stackdriver support