-
### ⚠️ This issue respects the following points: ⚠️
- [X] This is a **bug**, not a question or a configuration/webserver/proxy issue.
- [X] This issue is **not** already reported on [Github](https://…
-
## The plan for a user's autonomy / Server infrastructure
Hey folks,
thanks for your input on this.
### What is the goal?
Our promise is to keep the user in full control over his data and…
-
### ⚠️ This issue respects the following points: ⚠️
- [X] This is a **bug**, not a question or a configuration/webserver/proxy issue.
- [X] This issue is **not** already reported on [Github](https://…
-
### ⚠️ This issue respects the following points: ⚠️
- [X] This is a **bug**, not a question or a configuration/webserver/proxy issue.
- [X] This issue is **not** already reported on [Github](https://…
tfboy updated
3 months ago
-
### Your current environment
Docker Image: vllm/vllm-openai:v0.4.3 as well as 0.5.0 post-1
Params:
```
--model=microsoft/Phi-3-medium-4k-instruct
--tensor-parallel-size=2
--disable-log-requ…
-
### ⚠️ This issue respects the following points: ⚠️
- [x] This is a **bug**, not a question or a configuration/webserver/proxy issue.
- [x] This issue is **not** already reported on [Github](https://…
-
### Do you need to file an issue?
- [X] I have searched the existing issues and this bug is not already filed.
- [X] My model is hosted on OpenAI or Azure. If not, please look at the "model provid…
-
## What problem does this solve or what need does it fill?
One in 4,000 people have a form of photosensitive epilepsy (PSE).
This can trigger various forms of seizure, which can in turn be a risk …
-
### Is there an existing feature request for this?
- [X] I have searched the existing feature requests
### Describe the feature you would like to request
To enhance the Bitbox platform's capabiliti…
-
### ⚠️ This issue respects the following points: ⚠️
- [X] This is a **bug**, not a question or a configuration/webserver/proxy issue.
- [X] This issue is **not** already reported on Github _(I've sea…