-
```
1 06:25:58.936 | DEBUG | __main__:generate_stream_cogvlm:430 - ==== request ====
Describe what is in the image
INFO: 72.218.151.51:49747 - "POST /v1/chat/completions HTTP/1.1" 500 Intern…
-
### Your current environment
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubunt…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related issue y…
bltcn updated
1 month ago
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
对npu代码进行npu注入替换后,还是会报错,貌似是Qwen的代码的问题?
代码修改:
```python
import torch
import torch_npu
#自动映射cuda API…
-
**例行检查**
[//]: # '方框内填 x 表示打钩'
- [x] 我已确认目前没有类似 issue
- [x] 我已完整查看过项目 README,以及[项目文档](https://doc.fastgpt.in/docs/intro/)
- [x] 我使用了自己的 key,并确认我的 key 是可正常使用的
- [x] 我理解并愿意跟进此 issue,协助测试和提供反馈
…
-
### Your current environment
docker image: vllm/vllm-openai:0.4.2
Model: https://huggingface.co/alpindale/c4ai-command-r-plus-GPTQ
GPUs: RTX8000 * 2
### 🐛 Describe the bug
The model works f…
-
### System Info
- CPU architecture: x86_64
- CPU/Host memory size: 126G
- GPU properties
- GPU name: L4
- GPU memory size: 24GB
- Libraries
- TensorRT-LLM branch or tag (e.g., main, v0.…
-
### Search before asking
- [x] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar issues.
### Operating system information
Linux
### P…
-
目前将example.sh改为:
```
#!/bin/bash
#SBATCH --nodes=1
#SBATCH --gres=gpu:4
#SBATCH --cpus-per-task=28
#SBATCH --partition=gpu
#SBATCH --exclude=gpu19,gpu3,gpu8,gpu14,gpu4
#SBATCH --job-name=llava…
-
### ⚠️ 搜索是否存在类似issue
- [X] 我已经搜索过issues和disscussions,没有发现相似issue
### 总结
通义千问快速接入文档:https://help.aliyun.com/zh/dashscope/developer-reference/quick-start
官方文档里只需填写API-KEY即可调用(就像chatGPT一样简单),为什么本系统需要…