operate-first / support

This repo should serve as a central source for users to raise issues/questions/requests for Operate First.
GNU General Public License v3.0
15 stars 25 forks source link

add Prow metrics dashboard to grafana #374

Open goern opened 3 years ago

goern commented 3 years ago

Is your feature request related to a problem? Please describe. Prow is exposing a lot of metrics for example at http://gh-proxy-metrics-opf-ci-prow.apps.smaug.na.operate-first.cloud/metrics please make them available as a grafana dashboard. https://github.com/kubernetes/test-infra/tree/d917e4a1e773ccf701ac58424a0b4ee3490e8dd1/config/prow/cluster/monitoring/mixins/grafana_dashboards might be helpful

Describe the solution you'd like A grafana dashboard

Describe alternatives you've considered n/a

Additional context n/a

schwesig commented 2 years ago

/kind metrics /kind data-engineer /kind data-scientist /area monitoring

schwesig commented 2 years ago

@goern @harshad16 can this issue be closed because of

harshad16 commented 2 years ago

The dashboard for prow is still not yet built. This could be a good issue for someone interested in building dashboard. I would suggest making this issue frozen and in the backlog.

Removing all assignees as this is no longer in active

durandom commented 2 years ago

https://www.kubermatic.com/blog/monitoring-prow-resources-with-prometheus-and-grafana/ is another writeup to give some more context

durandom commented 2 years ago

but I cant figure out how to query prometheus for the actual prow component metrics

durandom commented 2 years ago

https://github.com/operate-first/apps/pull/2393 fixes user workload monitoring but also removes the above public routes

durandom commented 2 years ago

I imported all dashboards from https://github.com/kubernetes/test-infra/tree/d917e4a1e773ccf701ac58424a0b4ee3490e8dd1/config/prow/cluster/monitoring/mixins/grafana_dashboards to https://grafana.operate-first.cloud/dashboards/f/XfwHK1M4k/tmp

 ~/src/misc/test-infra/config/prow/cluster/monitoring/mixins |    master  |                                                                                                mhild
❯ make grafana-dashboards
 ~/src/misc/test-infra/config/prow/cluster/monitoring/mixins |    master  | ↵ SIGINT(2)                                                                                     mhild
❯ cd dashboards_out
 ~/src/misc/test-infra/config/prow/cluster/monitoring/mixins/dashboards_out |    master  |                                                                                 mhild
❯ perl -i -pe 's/prometheus/moc-smaug/' ./*
 ~/src/misc/test-infra/config/prow/cluster/monitoring/mixins/dashboards_out |    master  |              
durandom commented 2 years ago

/assign @durandom

goern commented 2 years ago

image