SeldonIO / seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
https://www.seldon.io/tech/products/core/
Other
4.33k stars 827 forks source link

Missing Grafana dashboard and support for k8s version Server Version: v1.27.5+k3s #5134

Open spicoflorin opened 11 months ago

spicoflorin commented 11 months ago

Hello!

I've installed the Prometheus operator as suggested here

https://docs.seldon.io/projects/seldon-core/en/latest/analytics/analytics.html#metrics-with-prometheus-operator

to monitor the deployed ML service.

I'm able to reach the prometheus UI. However, I could not find any information on how to install the corresponding Grafana Dashboard as it was for oldest versions of k8s.

Same issue was depicted: https://github.com/SeldonIO/seldon-core/pull/4514 and here https://github.com/SeldonIO/seldon-core/issues/4513

I understood that seldon-core-analytics was deprecated in the favor of Prometheus Operator.

Nevertheless, I missed out the Grafana Dashboard that is much more intuitive than Prometheus.

Can you please provide the installation guide for the Grafana dashboard for seldon for the newest versions of k8s, in the same way that was previously described here:

https://docs.seldon.io/projects/seldon-core/en/latest/charts/seldon-core-analytics.html

I look forward for your support.

Regards, Florin

agrski commented 11 months ago

Hi @spicoflorin,

For clarity, are you asking about Core v1 or Core v2? As you've already noted, Core v1 has long since moved away from the seldon-core-analytics chart and does not expect the use of Grafana. Core v2 has never used the aforementioned chart.

spicoflorin commented 11 months ago

Hi @agrski ! Thank you for the response. I'm referring to the Seldon Core V1. Per my understanding, you will no longer support Grafana charts for both of the versions (Core V1 and V2)?

If you no longer support Grafana, only the Prometheus monitoring is supposed to be the main tool used for monitoring the models performances?

Is there any plan to reinclude Grafana helm chart support for both V1 and V2? How can I make the https://github.com/SeldonIO/seldon-core/blob/master/helm-charts/seldon-core-analytics/files/grafana/configs/predictions-analytics-dashboard.json to work in my own GRafana installation?

Thanks. Florin