Closed meysholdt closed 2 years ago
/schedule
@JanKoehnlein: Issue scheduled in the meta team (WIP: 0)
During yesterdays incident we were on the wrong track for a while because connection counts are not surfaced in Grafana
Just wanted to point out that Grafana's Explore is always there for you to query metrics that are not shown in a dashboard 😬
@meysholdt Do we have a way now to add dashboards to Grafana from within the gitpod-io/gitpod repository? Or are we supposed to make the changes to the gitpod-io/ops repo? :thinking: Just wondering how team meta can take action on this one.
Do we have a way now to add dashboards to Grafana from within the gitpod-io/gitpod repository? Or are we supposed to make the changes to the gitpod-io/ops repo?
@geropl The guide: https://github.com/gitpod-io/gitpod/tree/main/operations/observability/mixins
I'll pick this up to learn the ropes.
/assign @laushinka
During yesterdays incident we were on the wrong track for a while because connection counts are not surfaced in Grafana. The metric endpoints are there, just graphs in Grafana are missing.
Metrics: https://github.com/gitpod-io/gitpod/blob/eed37839c4b1da0c9760dad40a27b7a81b5c1456/components/server/src/server.ts#L309-L310 https://github.com/gitpod-io/gitpod/blob/a1dc90b927c89524def92e7c542b90eaac1124fc/components/server/src/prometheus-metrics.ts#L28-L29 https://github.com/gitpod-io/gitpod/blob/a1dc90b927c89524def92e7c542b90eaac1124fc/components/server/src/prometheus-metrics.ts#L38-L39
Proposal: When https://github.com/gitpod-io/gitpod/pull/5843 is fixed, follow the "how we develop" manual to add new graphs to the "gitpod / components / server" dashboard.