-
### Is there an existing issue ? / 是否已有相关的 issue ?
- [X] I have searched, and there is no existing issue. / 我已经搜索过了,没有相关的 issue。
### Describe the bug / 描述这个 bug
加载微调后的MiniCPM-2B-dpo-bf16模型进行vllm推理时…
uRENu updated
2 months ago
-
### Expected Behavior
A few days ago, I used the flux nf4 model to generate an image in just 1 minute.
### Actual Behavior
![Snipaste_2024-08-22_10-27-48](https://github.com/user-attachments/assets…
-
### Your current environment
```text
The output of `python collect_env.py`
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12…
-
-
### Feature request / 功能建议
对模型的性能很期待,期望能提供使用ollama部署的方法。
-
### Is there an existing issue ? / 是否已有相关的 issue ?
- [X] I have searched, and there is no existing issue. / 我已经搜索过了,没有相关的 issue。
### Describe the bug / 描述这个 bug
同样的问题,命令行输出的比较完整,但是web demo输出很差,这是为什…
-
-
### Description / 描述
### 环境:
![20240205-171912](https://github.com/OpenBMB/MiniCPM/assets/48130519/5e9a0934-8237-440f-ad37-a06a0d008af6)
### 问题
使用这里提供的apk:https://github.com/OpenBMB/mlc-MiniCP…
-
![1713856321333](https://github.com/OpenBMB/MiniCPM-V/assets/26639421/64c9b538-1d49-4c94-bc77-6c81b53a611e)
![1713856452853](https://github.com/OpenBMB/MiniCPM-V/assets/26639421/b6bb0525-5d78-4960-80…
-
### Have I written custom code (as opposed to using a stock example script provided in MediaPipe)
None
### OS Platform and Distribution
mac os
### Mobile device if the issue happens on mobile dev…