search

Stackdriver / stackdriver-prometheus-sidecar

A sidecar for the Prometheus server that can send metrics to Stackdriver.
https://cloud.google.com/monitoring/kubernetes-engine/prometheus
Apache License 2.0
120 stars 43 forks source link

Adding new sources/jobs to be pushed to stackdriver #242

Open karolsochk opened 4 years ago

karolsochk commented 4 years ago

Hi All,

We're struggling a bit with custom job metrics being pushed to stackdriver, here's what we do:

  1. Install prometheus from helm
  2. Install a sidecar by patching deployment
  3. Installing a custom exporter for uwsgi and celery (in cluster services)
  4. Modifying prometheus' configmap to add a new scraping job that is utilizing exporters above
  5. Sending our exporter metrics to stackdriver (this doesn't work yet)

So, we're seeing all other kubernetes based prometheus metrics being sent to stackdriver, but not thje ones that come from our exporters. We've also confirmed they're present in prometheus and are being scraped correctly. Is there some secret sauce when you define a new scraping job in order for it to be sent correctly to stackdriver ?