-
### 🚀 The feature, motivation and pitch
I am running vLLM instances on Kubernetes, as likely are others. Currently there only is the `/health` endpoint https://github.com/vllm-project/vllm/blob/15a…
-
originally from pull request #113
> This PR will add endpoint api/v1/health to get the health status.
> It can be used as heartbeat and it's faster compare to request GET/HEAD to webui.
> It als…
-
Server and Analyzer should expose an HTTP-level endpoints that can be used as kubernetes life-probes.
As [discussed](https://github.com/src-d/minutes/pull/309/files#diff-d707b85ec18906cb2d5bedb7373…
-
### Issue: Request for Health Check Endpoint
**Description:**
I need an endpoint on your service to add a health check to determine if I need to kill/restart the application.
**Requirements:**
…
-
Getting some alerts where the `/health` endpoint is
```json
{
"diff": 3840,
"healthy": false,
"latest": 1687297790,
"latestHuman": "2023-06-20T21:49:50.000Z",
"reservoir": 16873016…
-
### Managed Service Monitoring
"As an operator, i want to monitor the health of various Unity services"
NOTE: S3 bucket is [defined here](https://github.com/unity-sds/unity-cs/issues/370).
An examp…
-
### Describe the bug
I have a TEI embedding model endpoint created like this:
```py
from huggingface_hub import create_inference_endpoint
repository = "thenlper/gte-large" #"BAAI/bge-reran…
-
llama.cpp exposes the `/health` endpoint, which makes it easy to deal with slots. What about other similar solutions?
-
### Describe the Bug
Since the update from 11.0.2 to 11.1.0, the endpoint "/server/health" returns error.
The reason is the check “storage:CLOUDINARY:responseTime". It has the error code "ERR_IN…
-
**Describe the enhancement**
When using automation to provision runners (Pulumi/Terraform/Puppet/Ansible), we need a way to ensure the VM was provisioned correctly. For example, when running using GC…