-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
### Anything you want to discuss about vllm.
We will make a triplet of releases in the following 3 weeks.
- [x] v0.5.2 on Monday July 15th.
- [x] v0.5.3 by Tuesday July 23rd.
- [ ] v0.6.0 afte…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing…
xyw1 updated
2 months ago
-
First of all, thank you for your impressive work! I've found that your model fares better than the latest LLAVA (13B) on some of my tasks.
I've tried running the GGUF version of MiniCPM-V2.0 on Local…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
#!/bin/bash
CUDA_VISIBLE_DEVICES=0 python ../../src/train_bash.py \
--stage dpo \
--do_trai…
-
### 起始日期 | Start Date
_No response_
### 实现PR | Implementation PR
_No response_
### 相关Issues | Reference Issues
_No response_
### 摘要 | Summary
如果可以,显存要求多大
### 基本示例 | Basic Example
无
### 缺陷 | …
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
Hi,
Could you let me know if everyone has successfully fine-tuned the model? Additionally, I have a question about GPU requirements: is 31.2GB needed per GPU, or is it split between two GPUs? Also, I…
-
web_demo.py 运行需要10G显存。为啥 vllm 启动api模式运行,需要23G显存啊?
python web_demo.py --device cuda --dtype bf16
Vllm运行命令如下
/services/srv/MiniCPM-vllm/venv/bin/python -m vllm.entrypoints.openai.api_server --mo…