-
### System Info / 系統信息
xinference==0.12.3,python3.10,vllm=0.5.3, cu121, transformer=4.42.4
### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
- [ ] docker / docker
- [X] pip install …
-
I'm not sure if this is a problem with runj, the containerd shim, or with the moby port (from https://github.com/gizahNL/moby), but If I write this minimal Dockerfile:
```Dockerfile
FROM kwiat/fre…
-
## Expected Behavior
https://github.com/temporalio/temporal/releases/tag/v1.22.5 images should exist
## Actual Behavior
`Failed to pull image "temporalio/admin-tools:1.22.5": rpc error: code = No…
-
**Please describe the feature you want**
I've been using a large completion model with my GPU. I'd like to add a chat model as well, but there's not enough GPU memory for the large completion model…
-
## Docker image version: 0.2.83
## Script
```
docker run -d \
--name llama-cpp-python \
--cap-add SYS_RESOURCE \
-e MODEL_DOWNLOAD="False" \
-e MODEL_REPO="local" \
-e MODE…
-
### System Info
```bash
gpu=0
num_gpus=1
model=meta-llama/Meta-Llama-3.1-8B-Instruct
docker run -d \
--gpus "\"device=$gpu\"" \
--shm-size 16g \
-e HUGGING_FACE_HUB_TOKEN=$token \
-p 8082:80 …
-
Dear collaborators
I use an Azure OpenAI Studio deployment with the model and deployment names set to the same values:
- `gpt-4-32k`
- `text-embedding-ada-002`
It's running on the Azure OpenAI s…
-
Description: With the successful deployment of the API Version 1.0, we need to put out the Version 2.0 with options to the use of the OCR model as well as the changes to the response json with inclusi…
-
Upon merge to "main" or when triggered by upstream build/release events, this project generates ready-made docker images at docker hub for users interested in "just using" OQS.
Currently, manual in…
-
**Description**
Bash completion script rises daemon error messages on `docker inspect`.
It felt really nervous to receive this alarm from monitoring system:
```
Jan 28 10:00:17 ip-x-x-x-x dock…