m-lab / prometheus-support

Prometheus configuration for M-Lab running on GKE
Apache License 2.0
19 stars 11 forks source link

Add storage cost panel #1034

Closed cristinaleonr closed 6 months ago

cristinaleonr commented 6 months ago

This PR adds a new Cost / Hour panel to the Cloud Storage Usage dashboard.

Notably, yesterday, there was an increase in Coldline Class A operation costs in staging (mlab-oti.billing.unified joins staging and production data). The cost increase happened because of the addition of the Lifecycle Management Rule to move data older than 12 months in archive-mlab-staging to Coldline storage (tracking).

Screenshot 2024-03-08 5 22 14 PM

The staging cost to move ~130M objects was $4,631.

Screenshot 2024-03-08 5 14 12 PM

There are 530M objects in archive-measurement-lab for which the same rule will be applied when it's added, meaning we can expect the move costs in measurement-lab to be around $18,524 (4 times as much).

Screenshot 2024-03-08 5 16 02 PM

The cost increase was (correctly) caught by the "Billing_DailyStorageIncrease" alert in staging. The panel will help us visualize increases in the future.

This change is Reviewable