Closed jjk-g closed 1 month ago
vllm entrypoint currently doesn't have metrics endpoint. Need to update the vllm base entrypoint to use vllm.entrypoints.openai.api_server to enable metrics.
vllm.entrypoints.openai.api_server
vllm entrypoint currently doesn't have metrics endpoint. Need to update the vllm base entrypoint to use
vllm.entrypoints.openai.api_server
to enable metrics.