-
### System Info / 系統信息
xinference 0.15.2
torch 2.4.0
torch-complex 0.4.4
torchaudio 2.4.0
torchmetrics 1.4.1
torchvision 0.19.0
python 3.11.9
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (…
-
### System Info / 系統信息
transformer-4.44.2,python-3.11,os-ubuntu18.04_x64
### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
- [ ] docker / docker
- [X] pip install / 通过 pip install 安装…
-
if yes then how ? :-))
-
### System Info / 系統信息
宿主机:cent7.9
cuda:12.4
python3.10
### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
- [X] docker / docker
- [ ] pip install / 通过 pip install 安装
- [ ] installa…
-
### Describe your problem
![QQ20240919-110315](https://github.com/user-attachments/assets/f9454e02-9e02-42aa-8b1b-d9fa6b678612)
My default model is named "qwen2-instruct" in System.
Why ragflow n…
-
[Issue 2055](https://github.com/xorbitsai/inference/issues/2055) seems still not fixed.
1. 模型文件更新为最新 [hugging face glm-4-9b-chat](https://huggingface.co/THUDM/glm-4-9b-chat/tree/main )
2. Xinferen…
-
### System Info / 系統信息
cuda 12.1,python editon 3.10.12
### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
- [ ] docker / docker
- [X] pip install / 通过 pip install 安装
- [ ] installatio…
-
### Your current environment
The output of `python collect_env.py`
```Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1…
-
### System Info / 系統信息
centos7,docker:26.0.0
### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
- [X] docker / docker
- [ ] pip install / 通过 pip install 安装
- [ ] installation from sou…
-
你好,
已经在Xinference中启动了reranker的模型,在RAG对话时查看chatchat的log看起来没有调用reranker模型。
谢谢!