-
### Your current environment
```text
The output of `python collect_env.py`
```
### How would you like to use vllm
I used llama3-8b and 70b to fine-tune a model. When testing the model, I …
-
Hello,
I'm trying to test head_dim=256 backward performance on H100, with below modifications, I manager to make it run. However, it reports test mismatch in result comparing.
Modifications:
1. a…
-
Hi guys, I have rather old version of Trident 21.10.0 and kubernetes 1.23.10, but it was working well up until yesterday when it stopped :)
We have a k8s cluster with Trident and OnTap NetApp used …
-
We need to update https://github.com/kubernetes/community/blob/master/contributors/devel/sig-architecture/feature-gates.md to fully incorporate the workflows and guidance for emulation version. This i…
-
I'm getting this error when running MIPRO:
```
AttributeError: 'Predict' object has no attribute 'new_signature'. Did you mean: 'signature'?
```
This is how I run MIPRO:
```
teleprom…
-
Hi team,
I am wondering, how can I get confirmation of the endpoints scanned when you scan with curl or openapi?
Our API has a lot of endpoints, and with the current output, I can't tell whether…
-
umami has now an official client : https://umami.is/docs/api/api-client
- [ ] switch to umami api client ([repo](https://github.com/umami-software/api-client) - [doc](https://umami.is/docs/api/api-cl…
-
## Description
Facing this error during the manual setup and with Docker setup as well .
Working on VM (linux)
{"category":"APP","errors":[{"attributes":{"genre":"TECHNICAL","http_status":500},"m…
-
### What happened?
etcd:
```
fatal: [k8s-m01]: FAILED! => {"changed": false, "cmd": "/usr/local/bin/etcd --version", "msg": "[Errno 2] No such file or directory: b'/usr/local/bin/etcd'", "rc": 2, "…
-
### 📜 Description
Right now, Novu API can only accept request size 100 KB at most. A simple trigger event is around 70 KB, but with `attachments`, it can easily exceed 100 KB, leading to code 413 Pay…