tensorflow / serving

A flexible, high-performance serving system for machine learning models
https://www.tensorflow.org/serving
Apache License 2.0
6.18k stars 2.19k forks source link

Export `:tensorflow:serving:build_info` for prometheus #2157

Open jeongukjae opened 1 year ago

jeongukjae commented 1 year ago

Feature Request

Describe the problem the feature is intended to solve

For now, TensorFlow Serving doesn't export build information for Prometheus. If tf serving exports metrics like promethues or redis exporter, it would be helpful for managing lots of services and pods in production. (e.g. finding outdated pods)

for example,

:tensorflow:serving:build_info{tensorflow_serving_git_branch="...", tensorflow_serving_git_commit="...", tensorflow_git_commit="...", cpu_arch="...", ...} 1

Describe the solution

Maybe export metrics in tensorflow_serving/model_servers directory using followings.

singhniraj08 commented 1 year ago

@jeongukjae,

Thank you for this feature request. Let me take this to team and we will update this thread once we have any updates.

jeongukjae commented 1 year ago

Any updates here?