google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
Apache License 2.0
21 stars 12 forks source link

Pass metrics client config through to Jetstream #99

Closed Bslabe123 closed 1 month ago

Bslabe123 commented 1 month ago

Is it metrics client or sever config? See: https://prometheus.github.io/client_python/exporting/http/