-
### Anything you want to discuss about vllm.
We will make a triplet of releases in the following 3 weeks.
- [x] v0.5.2 on Monday July 15th.
- [x] v0.5.3 by Tuesday July 23rd.
- [ ] v0.6.0 afte…
-
您好,每一定steps训练后跑验证的时候会多占用10GB显存资源导致有时会cuda out of memory。有解决办法吗?
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
device_map='auto'
> File "MiniCPM-Llama3-V-2_5/modeling_minicpmv.py", line 416, in chat
res, vision_hidden_states = self.generate(
File "MiniCPM-Llama3-V-2_5/modeling_minicpmv.py", line 326…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
### Describe the bug
使用[最新main代码](https://github.c…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
Requirement:
I have a custom API which takes in the inputs queries and passes it through a RAG pipeline and finally to llm and returns the result.
Question is, can I integrate it with Chat-UI (u…
-
# ComfyUI Error Report
## Error Details
- **Node Type:** Joy_caption
- **Exception Type:** RuntimeError
- **Exception Message:** User specified an unsupported autocast device_type 'cuda:0'
## S…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing…