GCS - Replication Metrics are Missing

[ajithkumar25b]

I have created a stack-driver exporter to scrape metrics for GCS component. All the metrics under storage.googleapis.com/replication is missing.

Configuration:

STACKDRIVER_EXPORTER_MONITORING_METRICS_TYPE_PREFIXES:  storage.googleapis.com, storagetransfer.googleapis.com                                                                                    
STACKDRIVER_EXPORTER_MONITORING_METRICS_INTERVAL:       10m                                                                                                                                        
STACKDRIVER_EXPORTER_MONITORING_METRICS_OFFSET:         0s    

Stack-driver image : prometheuscommunity/stackdriver-exporter:v0.14.1

Can anyone help me with this issue? Thanks in advance.

[maxkimambo]

Hi @ajithkumar25b The list of available metrics for storage.googleapis.com doesnt include transfer metric. See this page for all available metrics for cloud storage https://cloud.google.com/monitoring/api/metrics_gcp#gcp-storage

Start the stackdriver-exporter with following flags as an example ./stackdriver_exporter --monitoring.metrics-type-prefixes "storage.googleapis.com/network/sent_bytes_count"

Then in prometheus it should be available under stackdriver_gcs_bucket_storage_googleapis_com_network_sent_bytes_count metric

Hope this helps. Max.

[ajithkumar25b]

Hi @maxkimambo ,

Thanks for your input. The problem I 'm facing is, stack-driver exporter was not able to scrape metrics under storage.googleapis.com/replication see https://cloud.google.com/monitoring/api/metrics_gcp#gcp-storage under replication.

Based on your feedback, I have started a new stack-driver exporter with below configuration.

      --google.project-id=some-project
      --monitoring.metrics-interval=10m
      --monitoring.metrics-offset=0s
      --monitoring.metrics-type-prefixes=storage.googleapis.com/replication/missing_rpo_minutes_last_30d
      --stackdriver.backoff-jitter=1s
      --stackdriver.http-timeout=10s
      --stackdriver.max-backoff=5s
      --stackdriver.max-retries=0
      --stackdriver.retry-statuses=503
      --web.listen-address=:9255
      --web.telemetry-path=/metrics
      --monitoring.aggregate-deltas
      --monitoring.aggregate-deltas-ttl=30m

Prometheus didn't show any metrics related to storage.googleapis.com/replication/missing_rpo_minutes_last_30d.

[ajithkumar25b]

Need help on this issue !!!

- name: kpi-stackdriver-exporter-rpo
  metrics:
    typePrefixes: 'storage.googleapis.com/replication/'
    interval: 3800s
    offset: 30s
    aggregateDeltasTTL: '30m'

Not able to scrape metrics with prefix 'storage.googleapis.com/replication/'