Included Prometheus interceptor support for gRPC streaming

SeldonIO / MLServer

An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more

https://mlserver.readthedocs.io/en/latest/

Apache License 2.0

685 stars 178 forks source link

Included Prometheus interceptor support for gRPC streaming #1858

Closed RobertSamoilescu closed 1 month ago

RobertSamoilescu commented 1 month ago

This PR includes Prometheus interceptor support for gRPC streaming. Currently for gRPC streaming, we have to set "metrics_endpoint": null, thus Prometheus logs cannot be scraped. It also updates docs and test for Prometheus interceptor.