-
### Describe the solution you'd like
在语音模型中能否接入Qwen-Audio-Chat模型?我们发现whisper对中文的转录并不是太好,Qwen-Audio-Chat效果好得多,能否在语音模型中接入Qwen-Audio-Chat?
-
### Your current environment
```text
PyTorch version: 2.1.2+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 20.04.6 LTS (x86_64)
GCC …
-
PS F:\my-test> poetry run cover-agent `
>> --source-file-path="src/main/java/com/cvicse/yzc/YzcController.java" `
>> --test-file-path="src/test/java/com/cvicse/yzc/YzcControllerTest.java" `
>> …
-
用一张卡跑7b模型不会报错,用两张卡时报NCCL错误。vllm版本v0.3.2。
command:
python -m vllm.entrypoints.openai.api_server --model models/Qwen-14B-Chat --trust-remote-code --port 8509 --served-model-name qwen-14b-chat --dtyp…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
absl-py 2.1.0
accelerate 0.32.0
aiofiles …
-
### 问题类型 | Type of problem
模型推理和部署 | Model inference and deployment
### 操作系统 | Operating system
Linux
### 详细描述问题 | Detailed description of the problem
使用主分支最新代码。Docker部署,安装依赖。
推理Qwen-1…
-
### What feature or new tool do you think should be added to DevToys?
Tools like Copilot, ChatGPT or BingChat are truly helpful from a developer perspective.
### Why do you think this is needed?
Ha…
veler updated
5 months ago
-
### Ⅰ. Issue Description
ai-proxy + request block 客户端请求触发黑名单时直接 断开连接
### Ⅱ. Describe what happened
请求返回:
```
curl -vvv http://172.20.5.14:20080/api/openai/v1/chat/completions -d '{"messa…
-
### Is there an existing issue for the same bug?
- [X] I have checked the existing issues.
### Branch name
main
### Commit ID
369400c483ee74addb3ef45a5cd539f2c3e69e5d
### Other environment infor…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
# 基础模型
Qwen-14b-chat
# 训练数据
共4000条数据。单条数据长度不长于1024。
# cuda版本
NVIDIA-SMI 550.54.14 Driver Versi…