-
### Describe the bug
我们在压测xinference时候发现，V100 2卡，调用/v1/chat/completions接口，stream参数是True，模型用qwen-14b-chat，用jmeter10并发进行压测，压测1分钟xinference就挂了，如果stream是False,是可以的.
### 报错日志
```
2024-07-08 11:34:3…
-
-
### System Info / 系統信息
cuda:12.04
### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？
- [ ] docker / docker
- [ ] pip install / 通过 pip install 安装
- [X] installation from source / 从源码安装…
-
-
ElectricEel-24.10-RC.2
```
Tue, 22 Oct 2024 22:44:13 +0000 backend DEBUG TrueNAS GET Request through fetch: 504
Tue, 22 Oct 2024 22:44:13 +0000 backend ERROR Not found: Volume with name pvc-7ec72…
-
### Describe the bug
ChatTTS部署成功，界面可以看到。
日志：
2024-07-04 00:42:25,572 xinferen…
-
MicroProfile 7.0 is a major release with the current updated MicroProfile specifications:
1. MicroProfile Telemetry 2.0
2. MicroProfile Rest Client 4.0
3. MicroProfile OpenAPI 4.0
4. MicroProfile …
-
## C++
- [C++ REST SDK](https://m.blog.naver.com/PostView.nhn?blogId=drvoss&logNo=220340563782&proxyReferer=https%3A%2F%2Fwww.google.com%2F)
## Java(Swing)
- [Java Swing 관련 자료 많은 블로그 (1)](https:/…
-
using Jersy we want to change our structure to fix modelling issues with command mapping and open up more possibilities for further clean developement
Saphs updated
6 years ago
-
### System Info / 系統信息
cuda 12.4，transformers框架
### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？
- [ ] docker / docker
- [X] pip install / 通过 pip install 安装
- [ ] installation from …